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ABSTRACT 

This  thesis  investigates  the  problem  of  automatic 
transcription  of  the  morse  signal,  and  describes  and 
documents  several  approaches  to  filtering,  processing,  and 
decoding  it  for  transcription.   The  baseband  signal  is  first 
modeled  as  a  modified  random  telegraph  wave.   A  discrete 
Kalman  filter  and  a  linear  smoother  are  then  used  to  process 
the  demodulated  signal  in  order  to  gain  a  measure  of  the 
effectiveness  and  applicability  of  this  model.   It  is  shown 
experimentally  that  this  model  and  processing  yield  a 
significant  reduction  in  the  transcription  error  rate.   Next, 
a  Viterbi  decoder  algorithm  based  on  a  simple  Markov  model 
of  the  code  is  programmed  and  tested.   Finally,  the  base- 
band signal  model  is  incorporated  in  a  more  general  model 
for  pre-detection  Kalman  filtering.   It  is  shown  that  this 
filter  permits  acceptable  recovery  of  morse  signals  whose 
average  signal-to-noise  ratio  is  as  low  as  -14  dB  in  a  2  kHz 
bandwidth. 
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I.   INTRODUCTION 

Economic  inflation  and  the  national  commitment  to  the 
all-volunteer  Armed  Forces  concept  have  combined  to  produce 
unprecedented  increases  in  costs  of  both  manpower  and  weapon 
systems  in  recent  years.   The  public's  keen  awareness  of 
these  higher  costs,  together  with  less  than  enthusiastic 
support  of  defense  programs  in  general,  has  caused  Congress 
to  be  reluctant  to  authorize  increases  in  defense  expenditures, 
Thus  it  has  become  necessary  to  reduce  the  number  of  armed 
forces  personnel  in  order  to  keep  defense  expenditures  within 
authorized  limits.   This  reduction  has  had  the  effect  of 
intensifying  the  development  of  mechanization  of  appropriate 
manual  tasks  on  a  broad  front. 

Signal  surveillance  conducted  by  the  armed  forces, 
recognized  as  an  essential  and  integral  part  of  intelligent 
tactical  and  strategic  planning,  is  one  such  area  where 
automation  is  receiving  increased  attention  and  support.   In 
particular,  the  human  operator  has  long  been  relied  upon  to 
provide  the  necessary  manual  transcription  of  manual  morse 
circuits  under  surveillance.   Because  of  the  reduced  manpower 
levels,  this  surveillance  and  transcription  must  be  tranf erred 
to  mechanized  equipment  if  this  source  of  intelligence  is  to 
remain  timely  and  effective. 

This  thesis  investigates  the  problem  of  automatic  trans- 
cription of  the  morse  signal,  and  describes  and  documents 
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several  approaches  to  filtering,  processing,  and  decoding 
it  for  transcription.   The  baseband  morse  signal  process  is 
first  modeled  as  a  modified  random  telegraph  wave.   A  discrete 
Kalman  filter  and  a  linear  smoother  are  then  used  to  process 
the  demodulated  signal  in  order  to  gain  a  measure  of  the 
effectiveness  and  applicability  of  this  model.   It  is  shown 
experimentally  that  this  model  and  processing  yield  a 
significant  reduction  in  the  transcription  error  rate.   Next, 
a  Viterbi  decoder  algorithm  based  on  a  simple  Markov  model 
of  the  code  is  programmed  and  tested.   Finally,  a  more  general 
model  of  the  signal  process,  incorporating  the  baseband  model, 
is  used  to  design  and  implement  a  pre-detection  Kalman  filter. 


11 


II.   PROBLEM  DESCRIPTION 

A.   THE  MANUAL  MORSE  SIGNAL  PROCESS 

It  is  assumed  that  the  reader  is  familiar  with  the 
manual  morse  signal,  its  pecularities ,  vagaries,  and 
uncertainties,  and  with  current  methods  of  transcription. 
To  formalize  the  discussion,  however,  certain  definitions 
of  the  terms  used  and  a  brief  description  of  the  signal  are 
in  order. 

As  used  throughout  this  report,  the  term  morse  signal 
refers  to  International  Morse  Code,  sent  manually  by  key, 
manual  "bug",  or  electronic  keyer.   The  problem  of  tran- 
scribing keyboard  morse,  that  which  is  sent  automatically 
with  standard  parameters,  will  not  be  considered,  although 
certain  results  are  applicable.   The  baseband  morse  signal 
is  the  output  of  the  keyer  and  is  represented  by  the  logic 
levels  "0"  and  "1",  corresponding  to  the  states  "key  up" 
and  "key  down."   The  five  characters  of  the  international 
morse  code  are  identified  as:   dot,  dash,  element-space , 
letter-space ,  and  word-space.   The  term  element   refers  to 
the  standard  time  unit  of  the  code;  its  actual  duration  in 
seconds  will  of  course  vary  with  sending  speed.   Standard 
morse  code  consists  of  the  character  lengths  shown  in 
Table  I. 


Sometimes  the  terms  baud  and  bit  are  used. 
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TABLE  I 
STANDARD  MORSE  CHARACTERS 

Character              Symbol  Duration  (in  elements) 

Dot                       .  1 

Dash  3 

Element-space             ^  1 

Letter-space              ~  3 

Word-space               w  7 


The  standard  word  (including  word-space)  in  morse 
communication  is  50  elements  in  length.   Thus  the  element 
duration  in  seconds  for  a  given  sending  speed  may  be 
calculated  as  6/5  times  the  reciprocal  of  the  speed  in  words 
per  minute.   The  author  is  unaware  of  any  generally  accepted 
standard  for  the  bandwidth  of  the  baseband  morse  signal;  it 
was  found  to  be  convenient  to  express  the  upper  limit  of  the 
bandwidth  as  three  times  the  reciprocal  of  the  element 
duration.   Thus  a  code  speed  of  36  wpm  has  a  bandwidth  of 
90  Hz. 

An  actual  (as  opposed  to  standard)  morse  signal,  as 
those  familiar  with  the  problem  are  aware,  may  exhibit 
quite  a  wide  variation  from  standard  code  in  character 
duration,  speed  variability,  and  consistency  of  element 
duration.   Since  these  variations  are  often  unique  to  the 
particular  sending  operator,  and  in  many  cases  may  depend 
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on  the  type  of  traffic  being  sent  as  well,  it  is  difficult, 
if  not  impossible,  to  describe  a  "typical"  morse  signal. 
This  variability  is  illustrated  in  Figures  1  and  2,  which 
are  histograms  of  the  character  duration  of  two  different 
amateur  ratio  operators  recorded  on  the  air.   As  can  be  seen, 
the  distributions  are  different,  with  the  least  variability 
in  both  cases  appearing  in  the  dot  and  element-space 
durations . 

B.   SYSTEM  CONSTRAINTS 

The  signal  processor  will  obviously  play  an  important 
role  in  the  automated  manual  morse  intercept  and  transcription 
system.   In  order  to  fully  appreciate  the  system  constraints 
under  which  the  processor  was  developed,  and  the  context  in 
which  it  is  expected  to  operate,  an  outline  of  the  integrated 
system  is  presented.   Referring  to  the  system  block  diagram, 
Figure  3,  its  three  basic  components  may  be  briefly  described 
as  follows. 

1 .  Modulation  Sorting  Subsystem 

This  subsystem  scans  the  band  and/or  frequencies  of 
interest  and  detects  the  presence  of  morse  signals  in  a 
(typically)  2  kHz  band.   Upon  detection  of  a  morse  signal,  a 
separate  digitally-tuned  receiver  is  automatically  tuned  to 
the  signal  frequency  for  reception. 

2 .  Morse  Processor 

This  signal  processor  is  currently  the  only  part 
of  the  system  which  is  not  in  existing  hardware  or  software. 
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Its  basic  function  is  to  minimize  error  probability  in  the 
face  of  noise,  interference,  and  uncertain  signal  parameters. 
3 .   Automatic  Transcriber 

This  component  translates  the  code  into  letters  of 
the  alphabet;  there  are  currently  several  transcribers 
available  which  have  proven  effective  at  adequate  signal- 
to-noise  ratios  with  modest  signal  parameter  variation  [1],[2] 
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III.   DESIGN  OBJECTIVES 

* 

The  ultimate  goal  of  the  intercept  and  transcription 
system  is  to  provide  output  copy  with  an  error  rate  no 
greater  than  that  which  a  "good"  human  operator  can  provide. 
Such  an  operator  manually  transcribing  the  morse  signal  can 
adapt  rapidly  to  changing  signal  parameters  and  has  little 
trouble  distinguishing  dots  from  dashes  even  if  the  sender's 
keying  is  far  from  perfect.   Additionally,  he  can  adapt 
readily  to  the  noise  and  interference  environment  and  reliably 
copy  a  signal  in  the  presence  of  numerous  other  morse  and 
non-morse  signals. 

Specific  operator  performance  data  were  not  available  to 
the  author,  thus  only  broad  design  objectives  were  formulated 
based  on  a  limited  number  of  both  subjective  and  experimental 
data  obtained  using  amateur  radio  operators  as  subjects. 
Random  letter  sequences  were  sent  using  the  Pickering  model 
KB-1  morse  keyboard  to  key  a  signal  generator  at  an  audio 
frequency  selected  by  the  subject.   Noise  was  added  to  the 
audio  signal  and  the  SNR  in  each  bandwidth  used  was  recorded. 
The  results,  summarized  in  Table  II,  tabulate  error  rate 
versus  SNR  in  the  bandwidth  used.   Also  shown  is  the  SNR  in 
the  signal  bandwidth  as  previously  defined  in  Section  II. A. 

The  conclusions  drawn  from  these  data  is  that  a  good 
operator  can  copy  reasonably  well  down  to  -13  dB  SNR  in  a 
2  kHz  bandwidth.   Although  the  insertion  of  a  100  Hz  bandpass 
filter  raises  the  SNR  to  0  dB ,  the  relative  invariance  of 
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TABLE  II 
OPERATOR  PERFORMANCE  DATA 


(a)  Speed:   35  wpm 


BW 

SNR 
(dB) 

(in  given  BW) 

SNR 
(dB) 
(in  signal  BW) 

ERROR 
OP1 

RATE  (%) 
OP2 

COMMENTS 

2  kHz 
200  Hz 
100  Hz 

-13 

-3 

0 

0 
0 
0 

12 
11 
12 

15 
13 

14 

difficult  and 

fatiguing 

BW  too  narrow 

2  kHz 
200  Hz 
100  Hz 

-10 
0 
3 

3 
3 
3 

6 
11 

11 

10 

9 

10 

fatiguing 

BW  too  narrow 

2  kHz 
200  Hz 
100  Hz 

-7 
3 
6 

6 
6 
6 

1 
0 
2 

2 
1 
2 

relatively  easy 
prefer  wider  BW 

(b)  Speed:   25  wpm 


BW 

SNR 

SNR 

ERROR 

RATE  (%) 

COMMENTS 

(dB) 

(dB) 

(in  given  BW) 

(in  signal  BW) 

OP1 

OP2 

2  kHz 

-13 

2 

6 

5 

difficult  and 

200  Hz 

-3 

2 

7 

6 

fatiguing 

100  Hz 

0 

2 

8 

5 

2  kHz 

-10 

5 

2 

1 

relatively  easy 

200  Hz 

0 

5 

1 

1 

but  still  mildly 

100  Hz 

3 

5 

2 

2 

fatiguing 

2  kHz 

-7 

8 

1 

0 

easy  enough 

200  Hz 

3 

8 

0 

1 

100  Hz 

6 

8 

0 

2 
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error  rates  with  changes  in  filter  bandwidth  indicates  that 
the  ear  performs  the  necessary  filtering.   Strict  concentration 
is  required,  however,  at  this  low  SNR,  and  the  test  operators 
stated  they  would  not  attempt  to  copy  such  a  signal  unless 
strongly  motivated. 

Using  the  previously  defined  signal  bandwidth  for  each 
speed,  the  results  may  be  summarized  as  follows:   An  operator 
can  provide  copy  with  a  10-15%  error  rate  with  an  SNR  of 
approximately  0  dB  in  the  signal  bandwidth;  at  3  dB ,  the 
error  rate  is  5-10%;  and  at  6  dB ,  copy  is  practically  perfect. 

Based  on  these  results,  it  seems  reasonable  to  assert 
that  a  typical  field  operator,  faced  with  searching  for  and 
copying  morse  traffic  eight  hours  a  day,  would  not  be  inclined 
to  copy  signals  much  below  6  dB  SNR  in  the  signal  bandwidth 
unless  absolutely  required.   Thus  the  system  designer  must 
select  from  two  costly  alternatives:   1)  If  he  designs  the 
system  to  perform  as  well  as  the  good  operator  is_  able  to 
perform,  the  automated  system  will  reliably  receive  a  large 
percentage  of  signals  encountered  on  the  air,  but  it  is  likely 
to  be  complex  and  expensive.   2)  On  the  other  hand,  if  he 
designs  the  system  to  perform  as  well  as  a  typical  operator 
probably  performs,  the  automated  system  will  be  cheaper,  but 
the  remaining  operators  who  must  copy  the  low  SNR  signals 
which  are  not  machine  transcribable  may  become  too  fatigued 
to  be  efficient,  leaving  the  overall  man/machine  surveillance 
system  less  effective  than  the  existing  manual  system. 

Such  design  considerations  are  beyond  the  scope  of  this 
thesis;  using  the  "good"  operator  as  a  criterion,  the 
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ultimate  system  design  objectives  may  be  broadly  stated  as 
follows : 

1)  With  an  error  rate  of  10%  or  less,  recover  and 
decode  morse  signals  whose  SNR  in  a  2  kHz  bandwidth 
is  on  the  order  of  -10  dB,  using  standard  code  with 
additive  white  gaussian  noise  and  no  interference. 

2)  Track  the  time-varying  statistics  of  character 
lengths  in  order  to  enable  the  transcriber  to 
translate  the  code  properly. 
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IV.   PROCESSOR  DESIGN  PHILOSOPHY 

The  first  step  in  the  processor  design  was  to  model  the 
morse  code  as  a  random  telegraph  wave  with  non-stationary 
transition  probabilities.   Using  this  model,  several 
increasingly  complex  processing  methods  were  implemented, 
and  the  processing  gain  of  each  stage  was  determined.   First 
a  Kalman  filter  was  designed  to  filter  the  demodulated 
output  of  a  square-law  detector  with  and  without  narrowband 
analog  IF  filtering.   Next  a  smoothing  algorithm  was  added 
to  determine  the  effectiveness  over  Kalman  filtering  alone. 
Finally  a  maximum  a  posteriori  (MAP)  estimator  of  the  code 
characters,  using  the  smoothed  output  for  likelihood 
calculation,  and  using  the  Viterbi  algorithm  for  processing, 
was  programmed  and  tested. 

After  determination  of  the  error-reduction  effectiveness 
of  each  of  these  processing  stages,  a  more  general  model 
of  the  signal  process  was  used  to  design  a  Kalman  filter  for 
pre-detection  filtering.   The  objective  was  to  determine 
whether  or  not  such  filtering  yielded  any  advantage  over  the 
simpler  demodulation/post-detection  filter  approach.   A  block 
diagram  of  the  various  stages  is  shown  in  Figure  4.   Sections 
V  through  VII  present  a  theoretical  basis  for  each  of  the 
processing  stages,  followed  by  a  presentation  and  discussion 
of  experimental  results . 
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V.   BASEBAND  MODEL  AND  PROCESSOR 
The  baseband  morse  signal  may  be  modeled  as 

x(k+l)  =  x(k)  +  w(k)  (V-l) 

where  x  =  key  state  (0  or  1),  and  w(k)  is  a  random  forcing 
function  descriptive  of  the  morse  keying  process.   At  the 
output  of  the  demodulator,  the  signal  is  observed  as 

z(k)  =  x(k)  +  v(k) 

where  z (k)  is  the  observed  value  and  v(k)  is  the  additive 
noise.   This  model  gives  rise  to  the  following  scalar 
Kalman  filter  algorithm  [3] ,  [4] : 


^/i  \       V(klk-l)  ,   .  . 

G(k)  = — ' —  (gain) 

V(klk-l)  +  R 


V(k|k)  =  [1  -  G(k) ]V(k|k-l)  (estimation  variance) 

V(k+l|k)  =  V(k|k)  +  Q(k)  (prediction  variance) 

x(k|k)  =  x(k|k-l)  +  G(k)[z(k)  -  x(k|k-l)] 

(estimation) 

/\  ^. 

x(k+l|k)  =  x(k|k)  (prediction) 
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where: 

x(k)  =  estimate  of  x  at  time  k 

R    =  variance  of  the  observation  noise,  v(k) 

Q(k)  =  variance  of  the  random  forcing  function,  w(k).. 

Since  this  algorithm  implies  knowledge  of  the  variances  R 
and  Q,  procedures  for  their  estimation  are  required.   In 
order  to  keep  the  filter  algorithm  itself  as  simple  as 
possible,  estimates  of  Q  and  R  were  made  independently,  and 
used  by  the  filter  algorithm  as  if  these  were  the  true  values 

A.   ALGORITHM  FOR  ESTIMATING  THE  RANDOM 
FORCING  FUNCTION  VARIANCE 

The  random  forcing  function  w(k)  is  descriptive  of  the 

on-off  keying  process,  i.e.,  it  may  be  thought  of  as  the 

process  which  causes  the  transitions  in  the  x  state  from 

0  to  1  and  from  1  to  0 .   Referring  to  the  signal  model 

equation  (V-l) ,  the  keying  process  has  the  following 

interpretation:   If  x(k)  =  0  and  w(k)  =  0,  then  x(k+l)  =  0 

and  x  remains  in  the  space  condition.   If,  on  the  other  hand, 

w(k)  =  1,  x  shifts  (at  time  k+1)  from  the  space  condition  to 

the  mark  condition.   This  process  is  illustrated  in  Figure  5. 

Since  the  probability  of  occurrence  of  a  transition  is 

dependent  on  the  time  duration  since  the  last  transition, 

this  probability  is  non-stationary.   A  proper  description  of 

the  transition  probabilities  at  each  time  k,  then,  must 

necessarily  be  time  dependent  and  conditioned  on  the  element 
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Figure  5.   Illustration  of  Signal  Model  Proces: 
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duration  and  the  present  state.   The  following  probabilities 
are  therefore  required: 

P(w(k)=0 |k,x(k)=l)   =  Pr [remain  in  mark  condition]  (V-2) 

P(w(k)=l|k,x(k)=l)   =  0  (V-3) 

P(w(k)=-1 |k,x(k) =1)  =  Pr [transition  from  mark  to  space]  (V-4) 

P  (w(k)  =0  |k,x(k)  =0)   =  Pr [remain  in  space  condition]  (V-5) 

P (w(k) =1 |k,x(k) =0)   =  Pr [transition  from  space  to  mark]  (V-6) 

P(w(k)=-l|k,x(k)=0)  e  0  (V-7) 


Probabilities  (V-3)  and  (V-7)  are  identically  zero  since 
state  values  less  than  0  and  greater  than  1  are  not  allowable. 
The  remaining  probabilities  are  dependent  on  the  distributions 
of  dot,  dash,  element-space,  letter-space,  and  word-space 
durations  of  the  particular  morse  signal  being  received,  and 
are  dependent  in  a  Markov  sense  on  the  previous  character. 
The  Markov  nature  of  the  code  character  transitions  was  not 
taken  advantage  of  in  the  filtering  process.   Additionally 
it  was  assumed  that  a  particular  operator's  character 
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durations  are  all  distributed  with  uniform  density,  that 
the  dot  and  element  space  have  the  same  density,  and  that 
the  dash  and  letter  space  have  the  same  density.   The 
assumed  densities,  as  shown  in  Figure  6,  presume  for  the 
present  that  the  mean  values  T,  T, ,  and  the  parameters  I,    d 
are  either  known  or  have  been  determined  in  some  manner. 

Although  the  assumption  of  uniform  densities  for 
the  character  durations  of  any  particular  sending  operator 
is  probably  not  strictly  justifiable,  neither  is  the 
assumption  of  any  other  well-known  density,  such  as  a 
gaussian  or  exponential  density.   The  most  likely  candidate 
for  properly  modeling  these  duration   distributions  may  be 
a  gaussian-like  density  with  the  tails  truncated  at  suitable 
values.   The  complexity  of  estimating  the  parameters  of 
such  a  density  for  a  particular  received  signal,  together 
with  the  computational  burden  of  evaluating  the  error 
function,  erf(t),  for  the  probability  calculations  (V-2) 
through  (V-7)  at  each  sample  point,  motivated  the  selection 
of  the  uniform  density.   The  resulting  probability  computations 
are  relatively  simple  and  straightforward. 


2  8 


a)    Dot/Element-space    Duration    Density 


PdotW 


11 


T-£  T  T+£ 


b)  Dash/Letter-space  Duration  Density 


W1' 


Figure  6.   Character  Duration  Densities 
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1.   Mark  Transition  Probabilities 

A  description  of  probabilities  (V-2)  and  (V-4)  may 
be  obtained  by  first  conditioning  on  the  dot  and  dash 
probabilities,  and  noting  that  if  x(k)  is  still  in  the  mark 
condition  after  T+Z ,  then  the  mark  is  known  to  be  a  dash. 
Given  then  that  a  mark,  m,  is  a  dot,  and  given  T  and  £, 
probability  (V-2)  may  be  modeled  as 


P01(dot)  =  P(w(k)=0 |k,T,x(k)=l,m=dot)  =  /   Pdot(t)  dt 

k 


1   ;  0  <  k  <  T-l 


T-k  ,  1 
IT   +  2 


T-£  <  k  <  T+i 


0   ;  T+£  <  k 


Similarly,  for  a  dash: 


Td+d 


PQ1(dash)  =  P(w(k)=0|k,Td,x(k)=l,m=dash)  =  /    Pdash(t)  dt 

k 


1   ;  0  <  k  <_   Td-d 


-fa-  -  I  '         Ta-d  i k  i  Vd 


0   ;  T  ,+d  <  k 

'  d    — 
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Here  k  is  the  time  index  which  counts  the  number  of  units 
the  signal  has  been  in  the  mark  condition  on  the  present 
mark.   The  conditioning  on  m  must  be  removed  for  0  <_  k  <  T+l 
since  m  is  not  known  during  this  interval.   Thus  for  k  <  T+l: 

P(w(k)=0|k,T,x(k)=l)  =  P01(dot)Pr(dot)  +  PQ1 (dash) Pr (dash) 

(V-8) 
and  for  k  >  T+£ 

P(w(k)=0|k,Td,x(k)=l)  =  PQ1(dash)  .  (V-9) 

But  the  dot  and  dash  probabilities  are  dependent  on  the  type 
of  traffic  in  the  message,  i.e.  on  what  language  the  message 
is  in,  whether  it  is  plain  text  or  code  groups,  letters  only 
or  both  letters  and  numbers,  etc.  Since  the  traffic  type 
may  not  be  known  a  priori,  equiprobable  dots  and  dashes  were 
assumed  at  this  point.  Using  Pr(dot)  =  Pr(dash)  =  1/2,  then, 
equations  (V-8)  and  (V-9)  reduce  to 

1  0  <   k  <_  T-£ 

T-k     3 

TT  +  I         T-£  <  k  <  T+Jt 

P(w(k)=o|k,T,Td,x(k)=l)  =     1  T+l    <   k  <  Td~d 

4r  + 1         Vd  i  k  i  Td+d 


Td+d  <   k 
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Probability  (V-6)  follows  immediately  as 

P(w(k)=-l|k,T/Td/x(k)=l)  =  1  -  P(w(k)=0|k,T,Td,x(k)=l)  . 

The  expression  for  probability  (V-2)  as  a  function  of  time, 
k,  conditioned  on  the  present  state  and  dot  and  dash 
distributions  is  sketched  in  Figure  7. 
2 .   Space  Transition  Probabilities 

An  appropriate  description  for  the  space  duration 
probabilities  (V-4)  and  (V-7)  is  derived  similarly,  first  by 
conditioning  on  a  particular  space  and  then  removing  the 
appropriate  conditioning  by  using  the  relative  frequencies 
of  each  space.   Given  that  a  particular  space,  s,  is  an 
element-space,  then, 

1  0  <  j  <   T-£, 

T—  i    1 
P(w( j)=0 |x(j)=0,s=elem,T)  =       -jf-   +  J  T-£  <_  j  <_  T+£ 

0  T+Jl  <_  j 

(V-10) 

where  j  is  the  time  index  which  counts  the  number  of  units 
the  signal  has  been  in  the  space  condition  on  the  present 
space;  and  the  element  length,  given  T,  is  assumed  to  have 
the  same  uniform  density  as  the  dot  length. 
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Similarly  for  a  letter-space: 


P(w( j)=0 |x(k)=0,s=ltr-sp,Td)  = 


2d    2 


0  <  j  <   T,-d 


Vd  1  :  1  Td+d 


(V-ll) 


T,+d    j 


where  j  is  the  same  index  as  above  and  the  letter-space 
length,  given  T-,,  has  the  same  density  as  the  dash-length. 

For  the  word-space  it  was  decided  to  use  an 
exponential  model,  since  after  about  5T  units,  the  word-space 
is  (in  actual  practice)  about  equally  likely  to  end  at  any 
time: 


0  <  j  <  5T 


P(w( j)=0 |x( j)=0,s=word-sp,T)  = 


1  2T  ; 


5T  <  j  < 


(V-12) 
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The  conditioning  on  s  may  be  removed  by  observing  that  if 
j  >  T-,+d,  the  space  must  be  a  word-space;  if  j  >  T+Z,    then 
the  space  is  a  word-space  or  letter-space.   In  equiprobable 
letter  traffic,  the  needed  probabilities  are: 

Pr(s=elem-space)  = 12/17 
Pr (s=letter-space)  =  4/17 
Pr (s=word-space)   =  1/17 

Applying  these  probabilities  then  to  (V-10) ,  (V-ll) ,  and 
(V-12)  yields  the  desired  expression: 


P(w(j)=0  |j,T,Td,x(j)=0)    = 


0    <    j    <    T-& 


[T?+I]-T7  +  n-       '  T-*<j<T+£ 


1  T+Z    <    j    <_  T,-d 

[-5-T-  +   i  ]  •  i  +-=•      ;  T,-d    <    j    <    T,+d 

L2d2J55  d  J-d 


1  Td+d  K  i  -  5T 

e  5T   <    j 
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3.   Calculation  of  Variance 

The  variance  of  w(k)  is  now  easily  calculated  at 
each  time,  k,  as  follows: 
Let 


Pk(0,l)  =  Pr(w(k)=0|x(k)=l) 


Pk(-l,l)  =  Pr(w(k)=-l|x(k)=l) 


P.(0,0)  =  Pr(w(j)=0|x(j)=Q) 


P.(1,0)  =  Pr(w(j)=l|x(j)=0) 


Then,  if  x(k)  =  1, 


Q(k)  =  (0)2-Pk(0,l)  +  (-l)2.Pk(-l/l)  -  [E(w(k))]2 
=  P,  (-1,1)  -  [-Pv(-l,l)]2 


Pk(-l,l).Pk(0,l)  . 


Similarly,  if  x(j)  =  0, 


Q(j)  =  Pj(0,0) -P.(1,0)  . 


Since,  at  the  receiver,  the  true  state  x(k)  is  not 
known,  correct  estimates  of  Q  are  dependent  on  correct 
estimates  of  the  state,  x(k).   Thus,  it  is  expected  that  at 
some  SNR,  incorrect  estimates  of  x(k)  will  cause  the 
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estimates  of  Q  to  be  erroneous  enough  to  force  incorrect 
estimates  of  x(k+l) ,  causing  a  runaway  condition  to  develop 
and  yield  the  receiver  worthless.   This  SNR  at  which  runaway 
develops  was  determined  experimentally,  and  found  not  to  be 
a  serious  problem. 

B.   CHARACTER  DISTRIBUTION  ESTIMATION 

It  was  assumed  that  the  character  distributions  are 
appropriately  described  by  uniform  densities  with  known 
parameters  (expect  for  mean  values) .   More  sophisticated 
methods  of  distribution  and/or  parameter  estimation  were 
discarded  in  favor  of  simplicity.   Experience  suggests  that 
even  a  sloppy  sender  will  usually  not  exceed  an  l/T   or  d/T, 
ratio  of  about  1/3.   Thus,  once  estimates  of  T  and  T,  are 
obtained,  I   and  d  can  be  determined  from  this  assumption 
unless  these  ratios  are  known  in  advance.   The  mean  values 
T   and  T,   of  dot  or  element-space  and  dash  or  letter-space, 
respectively,  were  estimated  by  measuring  the  character 
durations  and  sequentially  averaging  the  appropriate  duration. 
Thus  T  is  the  mean  value  of  the  dot  and  element-space  durations, 
and  T^  is  the  mean  value  of  the  dash  and  letter-space  durations. 
The  threshold  for  deciding  which  set  of  measurements  a 
particular  length  belongs  to  was  set  at  the  halfway-point 
between  dot  and  dash  lengths.   The  algorithm  is  as  follows: 
Initially  specify: 

t,  =  shortest  dot-duration  expected, 

t~  =  longest  dot-duration  expected, 
with  t2  £  3t-,. 
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1.  (a)   Initialize  estimate  of  T  as  (t,+t~)/2. 
(b)   Initialize  estimate  of  T-  as  (3t,+3t2)/2. 

2.  Measure  the  duration  of  each  mark  and  space. 

3.  If  the  measured  value  is  less  than  (3t,+t2)/2,  then 
identify  it  as  a  dot/element  duration,  T..  . 

4.  If  the  measured  value  is  larger  than  (3t,+t2)/2,  then 
identify  it  as  a  dash/letter-space  duration,  T2 . 

5.  Estimate  the  means  recursively  by 

(a)  T(k)  =  T(k-l)  +  i  [^  -  T(k-l)]  . 

(b)  Td(k)  =  Td(k-1)  +  i  [T2  -  Td(k-1)]  . 


C.   OBSERVATION  NOISE  VARIANCE 

Although  the  noise  power  used  in  each  of  the  tests  was 
known  and  could  have  been  specified  initially,  it  was 
decided  to  estimate  this  parameter  in  order  to  better 
simulate  an  operational  environment  where  the  noise  power 
is  not  known  a  priori.   Although  the  method  is  purely 
intuitive  and  without  a  valid  theoretical  basis,  reasonably 
good  results  were  obtained. 

At  the  output  of  the  square-law  demodulator,  the  noise 
is  no  longer  gaussian  and  is  correlated  with  the  signal. 
Proceeding,  however,  as  if  the  signal  and  noise  were  not 
correlated,  the  noise  variance  R  can  be  obtained  by  sub- 
tracting the  morse  signal  power  from  the  total  received 
(demodulated)  signal  power: 
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~    /s     ~2 
z    4 


where  V   is  obtained  recursively  by  the  following 

£4 


Vz(k)  =  Vz(k-1)  +  \    [(z-yz)2  -  Vz(k-1)] 


and 


y   =  mean  value  of  the  received  (demodulated)  signal 

A. 

a  =  estimate  of  demodulated  signal  amplitude. 


The  parameters  y  and  a  were  also  estimated  on  line,  although 
they  too  are  known  a  priori  for  test  purposes.  The  estimator 
algorithm  for  a  is 

1)   a-^k)  =  a^k-l)  +  \    [z(k)  -  a^k-1)]     if  z(k)  >  yz 


(2)  a2(k)  =  a2(k-l)  +  |  [z(k)  -  a2 (k-1) ]     if  z(k)  <  yz 


(3)  a(k)  =  &1(k)  -  a2(k)  . 


The  mean  value,  y  ,  is  simply 

£1 


y  (k)  =  y  (k-1)  +  \   [z(k)  -  yz(k-l)]  . 
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D.   SMOOTHING  ALGORITHM 

The  Kalman-f iltered  output  represents  the  optimum 
linearly-filtered  estimate  of  the  signal  amplitude  in  the 
minimum  mean-square-error  sense  based  on  the  assumed  model 
and  the  efficiency  and  consistency  of  the  estimated 
statistics.   This  estimate  may  be  improved,  however,  by 
smoothing  the  data,  which  implies  consideration  of  future 
inputs  as  well  as  past  inputs  [4]. 

The  equations  for  the  discrete  optimal  linear  fixed- 
interval  smoother,  for  the  scalar  case,  expressed  as  a 
combination  of  a  forward-running  filter  and  backward-running 
filter  are  given  by  [5], [6]  as: 

Smoothed  Estimate: 

x(k|N)  =  P(k|N).[x(k|k)/Pf(k|k)  +  ^(k  |k+l)  /Pfa(k  |k+l)  ] 

Estimation  Variance: 


P(k|N)  = 


1/Pf (k|k) f 1/Pb(k|k+1)   ' 


where 

/s. 

x(k|k)  =  filtered  state  estimate 

Pf (k|k)  =  error  variance  for  the  forward  filter 

x,  (k|k+l)  =  (predicted)  estimate  for  the  backward  filter 

P,  (k|k+l)  =  (predicted)  error  variance,  backward  filter. 
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These  expressions  are  not  computationally  suitable,  however, 
since  P,  (k|k+l)  is  not  finite  when  k  =  N.   Alternate 
expressions  [6]  which  are  more  amenable  to  computation  are 
given  as  follows: 


Pf(k|k) 
Let      W(k)  =  1  -  pf (k|k)/Pb(k|k+l)  ' 


Then 

P(k|N)  =  [1 -W(k)/Pb(k|k+1)  ]Z-Pf  (k|k)  •  [W^(k)/Pb(k|k+1)  ] 

and 


1/Pb(k|k+1)  =  0   when   k  =  N 


Let      Wb(k|k+1)  =  xb(k|k+l)/Pb(k|k+l) 


Then 


*   i  x(k I k) 

x(k'N)  =  [1  +  P.(k|k)/P,(k|k+1)  ]  +  P(k|N)W,(k|k+l) 


and 


P(k|N)Wb(k|k+l)  =  0   when   k  =  N 
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These  equations  then  represent  the  smoothing  algorithm. 
As  noted  above,  forward-filtered  estimates  must  be  stored 
until  the  same  data  can  be  backward-filtered  and  combined 
to  produce  the  smoothed  state  estimate. 

The  smoothed  state  estimate  then  is  the  best  (linear) 
estimate  possible  for  the  given  model  and  parameter  estimators, 
and  any  improvement  in  error  rate  must  be  derived  from  giving 
more  probabilistic  structure  to  the  signal  model. 

E.   IMPLEMENTATION  OF  FILTER  AND  SMOOTHER 

A  diagram  of  the  test  signal  generation  method  is  shown 
in  Figure  8.   The  square-law  demodulator  was  selected  simply 
for  ease  of  implementation  since  an  analog  squarer  and 
appropriate  filters  were  readily  available  and  easily  inter- 
faced with  the  analog-to-digital  converter.   The  100  Hz 
low-pass  filter  permits  recovery  of  morse  signals  of 
approximately  35  wpm  or  less.   The  signal-to-noise  ratios 
used  throughout  this  report  are  average  (pre-detection) 
signal-to-noise  power  ratios  and  not  pulse  signal  power  to 
noise  power  ratios.   More  specifically,  the  average  signal 
power  in  the  morse  signal  is  defined  as 


2T 
Ps  =  2¥  f      [s(t)  J2  dt 


where  the  interval  [0,2T]  is  a  dot  and  element-space.   This 
expression  reduces  to 
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T  2T 

Pq   =   ^=  f       (a   cos   cat)2    dt      +      i  /        0    dt 
0  Zi    T 


Ps   =    a2/4       , 


which  is  3  dB  less  than  the  pulse  signal  power. 

The  noise  signal  is  taken  from  a  calibrated  white  gaussian 
noise  source  of  1  volt  rms. 

The  filter  and  smoother,  along  with  the  auxiliary 
estimation  algorithms,  were  coded  in  Fortran  and  implemented 
on  the  XDS-9  300  computer  interfaced  with  the  CI-5000  analog 
computer  for  analog  filtering  and  for  D/A  and  A/D  conversion. 
The  sampling  rate  was  50  0  samples  per  second,  and  the  value 
of  N  for  smoothing  was  chosen  to  be  250  samples.   The  sampled 
test  signal  was  recorded  on  tape  for  subsequent  processing, 
since  the  processing  required  approximately  4  seconds  for 
1  second  of  data.   The  test  signal  runs  consisted  of  the 
following: 

1.  Perfect  code  AR  sequence  and  random  letter  sequence  at 
speeds  of  35,  30,  and  25  wpm  each  with  a  signal-to-noise 
ratio  of  6,  5,  4,  3,  2,  and  1  dB  in  a  2  kHz  BW  with  no 
pre-detection  analog  filtering. 

2.  Perfect  code  AR  sequence  and  random  letter  sequence  at 
speeds  of  35,  30,  and  25  wpm  each  with  a  signal-to-noise 
ratio  of  -7,  -8,  -9,  -10,  -11,  -12  dB  in  a  2  kHz  BW  with 
a  100  Hz  pre-detection  analog  bandpass  filter. 
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3.  Sloppy  code  AR  sequence  at  nominal  speeds  of  2  5  and  30 
wpm  each  with  a  signal-to-noise  ratio  of  6,  5,  4,  3,  2, 
1  dB  in  a  2  kHz  BW  with  no  pre-detection  filtering. 

4.  Sloppy  code  AR  sequence  at  nominal  speeds  of  2  5  and  30 
wpm  each  with  a  signal-to-noise  ratio  of  -7,  -8,  -9, 

-10,  -11,  -12  dB  in  a  2  kHz  BW  with  a  100  Hz  pre-detection 
analog  bandpass  filter. 

The  output  of  the  processor  was  recorded  on  an  8-channel 

strip-chart,  using  a  utility  D/A  conversion  routine.   The 

outputs  were  as  follows: 

Channel  1:   Recorded  input  signal 

Channel  2:   Unprocessed  output  (input  signal  thresholded 
at  its  mean  value) 

Channel  3:  Kalman  filtered  output 

Channel  4:  Filtered  output  thresholded  at  0  V. 

Channel  5:  Smoothed  output 

Channel  6:  Smoothed  output  thresholded  at  0  V. 

Channel  7:  Option  of  filter  gain  or  noise  variance  estimate 

Channel  8:  Dot/element-space  duration  estimate. 

The  following  figures  (9-19)  are  typical  output  records, 
showing  examples  of  the  test  runs  for  each  signal  and  type 
of  sequence.   Channels  1-4  are  shown  in  Figure  (a)  in  each 
case  with  the  corresponding  channels  5  and  6  shown  in  Figure 
(b) .   An  example  of  the  output  of  channel  7  for  the  gain 
option  is  shown  in  Figure  20,  along  with  the  corresponding 
outputs  from  channels  1,  3,  and  4.   Figure  21  shows  an 
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example  of  the  outputs  for  the  noise  variance  estimate  and 
the  dot/element-space  duration  estimate  at  a  point  where  the 
input  signal  changes  from  25  to  30  wpm  and  the  signal-to- 
noise  ratio  changes  from  1  dB  to  6  dB.   In  all  cases  the 
chart  speed  was  10  mm/sec  except  in  Figure  21  where  5  mm/sec 
was  used  in  order  to  show  the  estimates  more  clearly.   The  scales 
for  channels  1,  2,  4  and  6,  and  for  channel  7  gain  option, 
are  5  v./div. ,  with  100  volts  corresponding  to  a  variable 
value  of  1.0;  the  scales  for  channels  3  and  5  are  2  v./div. 
For  the  channel  7  variance  option  the  scale  is  200  mv./div. , 
and  for  channel  8  the  scale  was  calibrated  at  4  msec/div. 

F.   RESULTS  OF  TESTS 

The  outputs  of  the  processor  were  decoded  by  hand  to 
determine  the  error  rates.   Using  the  estimate  of  T,  a  mark 
was  decoded  as  a  dot  if  its  duration  was  2T  or  less  and  as 
a  dash  otherwise.   Similarly,  a  space  was  decoded  as  an 
element-space  if  its  duration  was  2T  or  less,  as  a  letter- 
space  if  the  duration  was  between  2T  and  4T,  and  as  a  word 
space  otherwise. 

The  following  data  were  obtained  for  each  run: 

1.  Letter  error  rate  and  bit  error  rate  with  no  processing. 

2.  Same  error  rates  with  filtering  only. 

3.  Same  error  rates  with  filtering  and  smoothing. 

A  letter  error  occurs  when  any  transmitted  letter  is  not 
correctly  decoded.   Only  one  error  per  transmitted  letter 
is  counted;  for  example,  if  "A"  is  decoded  as  "ET" ,  one 
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letter  error  has  occurred.   On  the  other  hand,  if  "ET"  is 
decoded  as  "A",  two  errors  have  occurred,  since  neither  "E" 
nor  "T"  was  decoded  correctly.   Word  spaces  are  counted  as 
one  letter  per  7  elements.   The  sample  size  in  each  case  was 
approximately  200  letters.   A  bit  error  is  defined  as  at 
least  one  mark-space  error  occurring  within  a  transmitted 
element  duration.   Again,  only  one  error  per  element  is  counted, 
and  the  sample  size  was  approximately  200  bits. 

The  results  of  this  analysis  are  presented  in  Tables  III 
through  VI.   Column  1  lists  the  signal-to-noise  ratio  used 
without  a  100  Hz  pre-detection  filter;  column  2  lists  the 
signal-to-noise  ratio  used  with  the  100  Hz  filter  in  place. 
Both  the  bit  and  letter  error  rates  for  filtering  and 
smoothing  are  tabulated,  with  the  error  rates  for  the 
unprocessed  output  shown  for  comparison.   In  each  case,  the 
error  rates  are  shown  for  the  typical  (random  letter) 
sequence  and  the  AR  sequence,  except  in  Table  VI,  where  the 
results  are  for  the  AR  sequence  only  since  no  random  letter 
sequence  for  this  case  was  recorded.   Table  VII  shows 
typical  hand-translated  sequences  for  each  processing  stage. 

These  results  indicate  that  the  Kalman  filter  and  linear 
smoother  provide  a  significant  decrease  in  both  bit  and 
letter  error  rates.   By  using  a  100  Hz  bandpass  pre-detection 
filter,  such  processing  provides  a  tolerable  10%  letter  error 
rate  on  a  -7  dB  SNR  signal  as  opposed  to  an  unacceptable 
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TABLE  VII 
TYPICAL  TRANSLATED  SEQUENCES 


SENT 

UNPROCESSED 
FILTERED 
SMOOTHED 

SENT 

UNPROCESSED 
FILTERED  ' 
SMOOTHED 

SENT 

UNPROCESSED 
FILTERED 
SMOOTHED 

SENT 

UNPROCESSED 
FILTERED 
SMOOTHED 


QA  Z  WS  X  E  DC  R  F  V  T  GB  YHN  UJM 

??  ?  E  WH  XEIED?  E  FFV  T  GG  E  YHN  FJM 

??  ?  E  WH  X  IEDC  E  RFV  T  GG  YHN  UJM 

??  ?  WH  X  E  DC  E  RFV  T  GB  YHN  UJM 


QAZ 
IEQAZ 
IEQAZ 
EEQAZ 

QAZ 

QUAD 

QMZ 

QAZ 


WS  X   E   DC  RFV  T  GB  YHN  UJM 
PSEX   I   DCEFF7EA  GBEYHNEU?? 

??  X   I   DC  FFVIT  GB  YHN  UJM 

??  X   T   DC  RF?  T  GB  YHN  UJM 

WSX   E  E  DC  RFV  T  GB  YHN  UJM 

??XEEI  I  DC  E  LPVET  PBEYHNE7JME 

WHXEEI  I  DY  E  RFV  T  GB  YUN  F?ME 

WHX   I  I  DC  RFV  T  GB  QUNEUJM 


QAZ    WS  X    E  DC  RFV  T  GB  YHN  U 

Q?EZ  E  LS  X  EIH  ??  LFVIA  GB  E  YH7EV 

QAZ  E  WS  X  EEE  DC  E  RFVET  GB  YHN  U 

QAZ    WS  X    E  D?  E  RFV  T  GB  YHN  U 


SUMMARY: 


Error  Rate 

total  letters  sent 

125 

- 

unprocessed  errors 

58 

46% 

filtered  errors 

31 

25% 

smoothed  errors 

19 

15% 

(question  mark  indicates  untranslatable  sequence) 


BW  =  2  kHz    SNR  =  5  dB    speed  =  30  wpm    perfect  code 
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32-34%  error  rate  without  processing.   Smoothing  contributes 
considerably  to  a  reduced  error  rate  down  to  about  -9  dB 
where  its  effectiveness  over  filtering  alone  begins  to  fall 
off.   For  the  high  speed  35  wpm  signal,  runaway  of  Q  estimation 
occurs  at  approximately  -9  dB,  while  for  the  lower  speeds 
runaway  never  really  develops  until  the  SNR  reaches  -12  dB, 
since  filtering  always  provides  an  improvement  in  error  rate 
even  at  these  low  SNR's. 

It  was  noted  that  a  majority  of  the  errors  in  the  filtered 
and  smoothed  output  result  from  insertions  of  isolated  dots 
in  the  letter-space  and  particularly  the  word-space  separations 
A  possible  remedy  to  this  situation  is  to  incorporate  the 
Markov  structure  of  the  code  in  the  estimation  algorithm  for 
Q,  although  an  increased  susceptibility  to  runaway  may  limit 
its  effectiveness. 

Since  the  bit  error  rate  must  be  on  the  order  of  1%  or 
less  in  order  to  yield  a  tolerable  10%  letter  error  rate, 
it  was  felt  that  bit  error  rates  of  up  to  approximately  3% 
could  possibly  be  reduced  to  an  acceptable  level  by  use  of 
soft-decision  Viterbi  decoding  following  the  smoothed  output. 
If  such  a  reduction  were  possible,  then  acceptable  error 
rates  could  be  obtained  for  SNR's  down  to  -9  dB . 

Additionally,  pre-detection  Kalman  filtering  and  parameter 
estimation  would  yield  a  theoretical  gain  of  3  dB  or  more 
over  non-coherent  demodulation.   With  these  improvements  in 
the  processor,  then,  the  output  letter  error  rate  of  10% 
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could  be  achieved  on  signals  whose  SNR  is  on  the  order  of 
-12  dB  in  a  2  kHz  bandwidth  and  the  originally  stated  design 
objective  would  be  met. 

Both  of  these  possible  improvements  were  implemented 
separately  to  determine  the  effectiveness  of  each  one.   The 
Viterbi  decoder  algorithm  used  the  smoothed  output  of  the 
post-detection  Kalman  filter  as  input.   A  separate  program 
was  written  to  implement  a  pre-detection  Kalman  filter. 
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VI.   VITERBI  DECODER 

The  Viterbi  algorithm  [7], [8],  as  originally  formulated, 
is  a  maximum  likelihood  (ML)  sequence  estimation  decoding 
algorithm  for  convolutional  codes.   It  has  found  application 
in  other  areas  [9],  however,  and  its  use  has  been  extended 
to  maximum  a  posteriori  (MAP)  estimation.   It  is  the  MAP 
estimation  use  which  is  of  importance  here. 

A.   MAP  ESTIMATION 

In  order  to  transform  the  smoothed  output  of  the 
processor  into  characters  of  the  morse  code,  certain 
decision  criteria  must  be  formulated.   The  easiest  and  most 
obvious  way  to  accomplish  decoding  is  to  threshold  the 
smoothed  output  at  its  mean  value  and  determine  the  identity 
of  marks  and  spaces  on  the  basis  of  the  measured  duration 
of  each  received  character.   Such  a  scheme,  however,  fails 
to  utilize  two  sources  of  information  which  are  inherent 
in  the  smoothed  output:   1)  Thresholding  discards  all 
information  present  in  the  actual  smoothed  amplitude  estimate, 
and  2)  the  Markov  nature  of  the  character  transitions  is  not 
utilized. 

The  decoding  problem,  then,  is  to  take  advantage  of  this 
additional  information  to  determine  the  most  probable 
sequence  of  morse  characters.   The  thresholded  output  may  be 
used  to  make  tentative  decisions  to  obtain  a  specific 
sequence  of  character  outputs  z  ,...,z  ,  where  a  particular 
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z-  is  either  a  dot,  dash,  element-space,  or  letter-space. 

It  is  the  objective,  then,  to  find  a  specific  sequence  of 

transmitted  characters  x  .  ...,x  which  maximizes  the 

o      n 

probability  that  x  ,...,x  was  transmitted,  given  that 

z  ,  ...,z   was  received.   Formally,  it  is  desired  to  find 

the  sequence  x.  =  x  ,  ...,x  which  gives 
^      — j     on       3 


P  (x=x  .  |z_=z_. )  =  maximum 


where  z_.  is  the  specific  received  sequence,  and  all  possible 
sequences  of  transmitted  characters,  x,  are  used  to  determine 
which  specific  sequence  yields  the  maximum  value.   The 
sequence  x.  which  yields  the  maximum  is  then  the  maximum 
likelihood  estimate  of  the  transmitted  sequence  if  it  is 
assumed  that  the  transmitted  characters  are  equiprobable; 
it  is  the  maximum  a  posteriori  (or  minimum  error)  estimate 
if  the  actual  probability  of  transmission  of  each  character 
is  utilized  [10] . 

In  general,  it  would  be  necessary  to  compute  and  compare 
the  probability,  P  (x=xo  ljE.=JE.- )  '  f°r  a^  possible  sequences  x«. 
However,  if  it  is  assumed  that  the  morse  code  is  a  Markov 
source,  then  the  problem  of  finding  the  MAP  estimate  reduces 
to  a  problem  of  maximizing  a  sum  and  the  Viterbi  algorithm 
may  be  used. 

In  the  following  development,  a  shorthand  probability 
notation  is  used  to  facilitate  writing  of  probability 
statements.   The  statement  P(x,  |z,  )  is  used  to  mean 
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P(x,=a.  |z,=a.)  where  the  a., a.  are  the  characters  of  the 
code,  i.e.,  dot,  dash,  element-space,  letter-space.   No 
confusion  should  result,  since  in  all  cases  the  notation 
P(u)  is  intended  to  mean  the  probability  that  u  is  equal 
to  some  specific  value. 

B.   SOURCE  MODEL 

A  third-order  Markov  model  of  the  morse  code  exhibits 
a  good  deal  more  probabilistic  structure  than  a  first-order 
model,  as  can  be  seen  by  comparing  the  transition  probabilities 
shown  in  Table  VIII.   In  the  interest  of  simplicity,  however, 
it  was  decided  to  use  a  first-order  model.   The  assumption  of 
a  first  order  model  then  means  that 

P(xk|xo, .. . ,xk_x)  =  P(^k|xk_1) 

where  x,  is  the  kth  character  of  a  transmitted  sequence. 
The  transition  matrix  lists  the  following  transition 
probabilities : 

P(x,  |x,  ,)       for  each   x,  =  a. 
k '  k-1  k    1 

where 

(Vl-la) 

(Vl-lb) 

(VI-lc) 

(Vl-ld) 


al 

• 

(dot) 

a2 

— 

(dash) 

a3 

==    /\ 

(element- space) 

a4 

=    ~ 

(letter-space) 
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TABLE    VIII 
MARKOV   TRANSITION    PROBABILITIES 


FIRST-ORDER   MODEL 


• 

/\ 

~ 

MS 

• 

0 

.682 

.318 

0 

y\ 

.554 

0 

0 

.446 

~ 

.5 

0 

0 

.5 

— 

0 

.684 

.316 

0 

THIRD-ORDER   MODEL 


• 

•N 

~ 

— 

•  •s.  • 

0 

.438 

.562 

0 

•  /\amm 

0 

.615 

.385 

0 

•  **  • 

0 

.923 

.077 

0 

#    -*,•" " 

■ 

0 

.923 

.077 

0 

/\  m   A 

.556 

0 

0 

.444 

/\  •   *- 

.50 

0 

0 

.50 

•N.— "*/^ 

.538 

0 

0 

.462 

•\  ""--»' 

.50 

0 

0 

.50 

•**     •     /\ 

.50 

0 

0 

.50 

.50 

0 

0 

.50 

-"~*~/\ 

.583 

0 

0 

.417 

..— ~ 

.50 

0 

0 

.50 

"""  /\  « 

0 

.571 

.429 

0 

—a.— 

0 

.545 

.455 

0 

'  ***     • 

0 

.923 

.077 

0 

— ~  — 

0 

.923 

.077 

0 
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(Word  spaces  were  not  considered  as  separate  characters, 
but  as  combinations  of  letter-spaces  and  element-spaces.) 

C.   SEQUENCE  PROBABILITIES 

Based  on  the  first  order  model  assumption,  the  probability 
of  any  particular  transmitted  sequence  of  length  n  is  given  by 

n-1 
P(xo,x1,...,xn_1)  =   JI   P(xi|xi_1)  (VI-2) 

Then,  given  an  input  sequence  to  the  decoder  (z  ,  ...,z  _•])> 
use  of  Bayes '  rule  expresses  the  desired  conditional 
probability  as 

P(xQ,  .  .  .  'xn_;]Jz0/  •  •  •  'zn-]_) 


P(zp/. . .  fzn-i\xQt  ••  -^xn-i)  -p(x0^  •  •^xn-l) 
P(zq, .. . ,zn_1) 


(VI-3) 


which  is  the  probability  to  be  maximized. 

Assuming  that  the  thresholded  output  is  memory less,  the 
conditional  output  sequence  probability  becomes: 

n-1 
p<zo zn-llxo'----*h-l)  =  .*Q   P(z±lx±)  *  (VI"4) 

Although  the  thresholded  output  is  by  no  means  memory less, 
due  to  the  decision  directed  nature  of  the  Q  estimation 
algorithm  in  the  preceding  filter,  this  assumption  is 
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nevertheless  made  in  order  to  render  the  computation  of  the 
necessary  probabilities  tractable.   The  dependence  of  the 
thresholded  character  output  decision  on  previous  and  future 
decisions  will  be  removed  to  a  certain  extent  in  Section  D, 
justifying  the  assumption  of  memory lessness  at  this  point. 

Then,  using  (VI-2)  and  (VT-4)  ,  and  realizing  that 
P(z  ,  ...,z  _,)  is  constant,  maximization  of  (VT-3)  is 
equivalent  to  maximizing  the  expression: 

n-1  n-1 

n   P(x. |x.  ,)    n   P(z. |x.)   . 
i=0     x   1~x   i=0     1 

Maximization  of  this  sequence  is  equivalent  to  minimizing 
the  negative  logarithm,  since  In  P ( • )  is  a  monotonic  function 
of  P ( • ) .   Thus 


A    n~"'" 
L(x  ,...,x   1)  =  -   E   [In  P(xi|xi„1)  +  In  PCz-Jx.)] 

i=0 


is  the  function  to  be  minimized  by  the  Viterbi  algorithm. 
An  outline  of  how  the  Viterbi  algorithm  performs  this 
minimization  is  presented  in  Appendix  B. 

D.   LIKELIHOOD  COMPUTATION 

The  likelihoods  P(z. |x-)  may  be  computed  from  the  smoothed 
signal  amplitude  and  received  character  duration  as  follows. 

Define  the  following  figures  of  merit  for  amplitude  and 
duration: 
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a   =  amplitude  figure  of  merit  for  a  dot-length  duration 
t  =  time  figure  of  merit  for  a  dot-length  duration 
A  =  amplitude  figure  of  merit  for  a  dash-length  duration 
T   =  time  figure  of  merit  for  a  dash-length  duration 
If  these  figures  of  merit  are  scaled  such  that  their 

values  are  between  0  and  1,  then  they  may  be  interpreted 

as  follows: 

a  =  probability  that  a  mark  occurred  during  a  dot- length 
interval. 

t  =  probability  that  a  mark  is  a  dot,  or 

=  probability  that  a  space  is  an  element-space. 

A   =  probability  that  a  mark  occurred  during  a  dash-length 
interval . 

T   =  probability  that  a  mark  is  a  dash,  or 

=  probability  that  a  space  is  a  letter-space. 

Likelihoods,  then,  may  be  computed  by  utilizing  these  values 

as  probabilities.   For  example,  the  probability  that  the 

thresholded  output  is  a  dot,  given  that  the  input  is  an 

element-space  is  simply: 


P  (z=a,  |  x=a-.) 

=  Pr (z=dot | z=mark)  «Pr (z^dash | z=mark) 'Pr(z=mark) 


=  t  • (1-T  ) -a 
m     mm 
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The  likelihoods  for  each  case  were  determined  as  above 
and  are  given  as  follows: 


P (z=a,  |x=a. )  =  a  t  (1  -  T  ) 
1 '    1     m  mv     m' 


P(z=a9|x=a.  )  =  a  (1  -  t  (1-T  )) 


P(z=a0  x=a.)  =  (1-a  )t  (1-T  ) 
31    i         m  m     m' 


P(Z=a4|x=ai)  =  d-am)(l  -  tm(l-V) 


for   i   =   1,3      where   the   a.    are   given  by    (VI-1) ;    and 


P(z=a,    x=a.)    =  a    (1-T    (1-t   )) 

1 '         i  m  m  m 


P(z=an   x=a.)    =  A  T    (1-t   ) 

v         2  '         i  mm  irr 


P(z=a-    x=a.)    =    (1-a   )  (1  -   T    (1-t    )) 

3 '         l  m  m  m 


P(z=a.    x=a.)    =    (1-A   )T    (1-t   ) 
4  '         l  mm  m 


for   i   =   2,4. 

The  figures  of  merit  a  ,  A  ,  t  ,  T  were  obtained  by 
using  the  thresholded,  smoothed  output  to  make  "tentative" 
decisions,  and  then  computing  the  merit  of  these  decisions 
The  tentative  decisions  were: 
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1)  If  x    =1  and  measured  duration  <  2T,  then  x,  =  dot 

out  —  k 

2)  If  x   .  =  1  and  measured  duration  >  2T,  then  x,  =  dash 
'      out  '       He 

3)  If  x    =0  and  measured  duration  <  2T,  then  x,  =  element- 

out  —    '        k 

space 

4)  If  x   .  =  0  and  measured  duration  >  2T,  then  x,  =  letter- 

out  '        k 

space 


For  x,  =  dot  or  element-space,  the  previous  T  values  of 
smoothed  output  were  averaged  and  the  amplitude  figure  of 
merit  was  taken  as 


"  T  ±xs(T) 


m 


x  (T)/a  +  0.5 


|iJsm  i-f 


where 


XS(T)  >  | 


x  (T)  =  the  average  of  the  smoothed  output,  x  ,  over  the 
previous  T  seconds . 

/\ 

a     =  amplitude  of  smoothed  output  signal. 


The  time  figures  of  merit  were 


0  <  t ,  <  T 

—   d  — 


t   =     2  -  (t,  +T)/2T       T  <  t ,  <  3T 
m  d     '  —   d  — 


3T  <  t, 
—   d 
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o  <  «=a  i  Td/3 


Tm=  1   -    (Td-td)/(0.67Td)         Td/3<td<Td 


Tdi  fcd 


where  t,  =  measured  duration  of  character  duration. 

These  functions  are  sketched  in  Figure  22.   For  x,  =  dash 

or  letter-space,  the  previous  T,  values  of  x  were  averaged 

to  obtain  the  value  for  A  : 

m 


f  i*s<Td> 


A 
m 


a  ^  —  ,m  ,  ^    a 


x(T)/a+0.5  ?ixs(Tc^--2 


X. 


a 
s^d   -  2 


<yi 


These  likelihood  computations  allow  decisions  to  be  made 
by  the  Viterbi  algorithm  to  determine  the  most  likely 
character  on  a  character-versus-character  basis.   It  was 
necessary,  however,  to  extend  these  computations  to  cover 
more  complicated  situations  such  as  that  depicted  in  Figure  23 
The  thresholded  output  shown  decodes  as  .  ^.^.  ,  although  the 
sequence  . A-  was  actually  transmitted.   The  Viterbi  algorithm 
implemented  using  the  above  likelihood  computations  decoded 
the  sequence  as  .  ^— ~ .  ,  however,  since  no  provision  was  made 
to  account  for  the  non-memory less  nature  of  the  thresholded 
output. 
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a)  Amplitude  Figure  of  Merit 


b)  Duration  Figures  of  Merit 


0.5-' 


Figure  22.   Sketch  of  Figures  of  Merit 
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Smoothed 
Output 


1  . 


-1  - 


Time 


Thresholded 
Output 


1  - 


iime 


Figure  23. 


Illustration  of  Signal  Requiring 
Modified  Likelihood  Computation 
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Two  modifications  were  made,  therefore,  in  order  to 
account  for  situations  such  as  this:   First,  when  a  dash  or 
letter-space  was  decoded  by  the  thresholded  output,  this 
character  was  divided  into  three  equal  segments  and  dot  and 
element-space  likelihoods  were  computed  for  each  segment. 
Secondly,  when  the  thresholded  output  consecutively  decoded 
three  short  characters,  then  the  total  duration  of  all  three 
characters  was  obtained  and  dash  and  letter-space  likelihoods 
were  computed  for  the  total  interval. 

E.   IMPLEMENTATION  AND  RESULTS 

The  algorithm  was  coded  in  Fortran  and  run  as  a 
subroutine  of  the  original  Kalman  filter  and  smoothing 
programs.   Sequences  of  9-11  elements  in  duration  were 
decoded.   In  order  to  determine  the  contribution  of  context 
information  supplied  by  the  first  order  transition 
probabilities,  the  algorithm  was  also  run  with  equiprobable 
transition  probabilities,  i.e.  as  a  ML  sequence  estimator. 

The  results  are  summarized  in  Tables  IX  and  X.   Again 
both  bit  and  letter  error  rates  are  presented  with  the  hand- 
decoded  smoothed  output  repeated  here  for  ease  of  comparison. 
Table  XI  shows  a  comparison  of  bit  error  rates  for  ML  and 
MAP  estimation  showing  a  slight  improvement  provided  by  the 
MAP  estimation,  taking  advantage  of  transition  probabilities. 

The  reduction  in  error  rate,  although  not  as  great  as 
hoped  for,  shows  that  the  thresholded  output  bit  error  rate 
can  be  improved  significantly  at  the  higher  SNR's,  but 
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TABLE     IX 
VITERBI    DECODER   ERROR   RATES    -    35   wpm 

AR   SEQUENCE,    PERFECT    CODE: 


SNR   (2  kHz)  SMOOTHED  OUTPUT 


VITERBI  OUTPUT 


TYPICAL   SEQUENCE,    PERFECT    CODE: 


SNR   (2  kHz)  SMOOTHED  OUTPUT 


VITERBI  OUTPUT 


IMPROVEMENT  RATIO 
IN  BIT  ERROR  RATE 


NO  PRE-FILTER 

BIT 

LTR 

BIT 

LTR 

(db) 

(%) 

(%) 

(%) 

(%) 

6 

0.83- 

9 

.35 

3 

2.4 

5 

3.0 

27 

2.5 

23 

1.2 

4 

6.7 

49 

6.8 

49 

- 

3 

35 

96 

35 

100 

— 

IMPROVEMENT  RATIO 
IN  BIT  ERROR  RATE 


NO  PRE-FILTER 

BIT 

LTR 

BIT 

LTR 

(db) 

(%) 

(%) 

(%) 

(%) 

6 

0.70 

8.0 

0.33 

3 

2.1 

5 

1.2 

15 

0.90 

11 

1.3 

4 

4.5 

34 

4.4 

34 

- 

3 

30 

92 

30 

96 

— 
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TABLE  X 
VITERBI  DECODER  ERROR  RATES  -  25  wpm 

AR  SEQUENCE,  PERFECT  CODE: 


SNR   (2kHz) 


SMOOTHED  OUTPUT 


VITERBI  OUTPUT 


TYPICAL   SEQUENCE,    PERFECT    CODE: 


SNR    (2kHz)  SMOOTHED  OUTPUT 


VITERBI  OUTPUT 


IMPROVEMENT  RATIO 
IN  BIT  ERROR  RATE 


NO  PRE-FILTER 

BIT 

LTR 

BIT 

LTR 

(db) 

(%) 

(%) 

(%) 

(%) 

6 

.77 

10 

0.31 

2 

2.5 

5 

1.3 

17 

1.0 

13 

1.3 

4 

1.7 

18 

1.5 

17 

1.1 

3 

4.5 

36 

4.4 

38 

_ 

IMPROVEMENT  PATIO 
IN  BIT  ERROR  RATE 


NO  PRE-FILTER 

BIT 

LTR 

BIT 

LTR 

(db) 

(%) 

(%) 

(%) 

(%) 

6 

0.70 

8 

0.37 

3 

1.9 

5 

1.1 

12 

0.80 

10 

1.4 

4 

1.2 

15 

0.90 

13 

1.3 

3 

2.9 

24 

2.7 

22 

1.1 
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TABLE     XI 
COMPARISON    OF    ML   AND   MAP    ESTIMATES 


SNR   (2kHz) 

MAXIMUM  LIKELIHOOD 

MAXIMUM  A-POSTERIORI 

IMPROVEMENT 

NO  PRE-FILTER 

ESTIMATOR 

ESTIMATOR 

RATIO 

(db) 

BIT  ERROR  RATE 
(%) 

BIT  ERROR 
(%) 

RATE 

6 

0.45 

0.37 

1.2 

5 

0.91 

0.80 

1.1 

4 

1.1 

0.90 

1.2 

3 

2.8 

2.7 

1.0 

Typical  sequence  25  wpm,  perfect  code 
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bit  error  rates  of  about  3%  or  higher  remain  practically 
unaffected.   Again,  it  was  noted  that  most  errors  are 
isolated  dot  insertions  during  word-spaces.   Since  the  third 
order  model  accounts  for  the  small  transition  probability 
of  such  events,  such  a  model  should  virtually  eliminate  this 
type  of  error,  resulting  in  a  very  significant  decrease  in 
error  rates. 

Table  XII  shows  a  typical  decoded  sequence  as  output  by 
the  algorithm,  with  the  filtered  and  smoothed  outputs  shown 
for  comparison.   'This  sequence  was  part  of  the  35  wpm  AR 
sequence  at  5  dB  SNR  in  2  kHz.   Since  it  was  noted  that  the 
algorithm  created  some  new  errors  as  well  as  correcting 
errors,  likelihood  computations  could  probably  be  improved 
by  employing  better  character- length  density  estimation 
procedures . 

Two  examples  of  likelihood  computations  and  the  evolution 
of  the  most  likely  sequence  as  the  algorithm  progresses  are 
shown  in  Tables  XHIa  and  b.   Table  XHIa  is  an  example  of 
decoding  with  highly  probable  likelihoods,  while  Table  XHIb 
shows  an  example  of  a  correction  by  the  algorithm.   The  array 
of  numbers  headed  by  SURVIVOR  SEQUENCES  indicate  to  which 
previous  node  the  node  at  stage  k  is  connected;  the  length 
of  each  survivor  sequence  is  shown  immediately  below  this 
array.   The  line  through  the  survivor  sequence  array  shows 
the  final  path  for  the  minimum- length  sequence.   The  next 
array  shows  the  computed  log-likelihoods  for  each  character, 
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followed  by  the  minimum  length  sequence  with  its  length. 
(The  number  200  was  sufficiently  large  to  be  used  for 
infinity.)   Finally,  the  mark  and  space  durations  as 
determined  by  the  thresholded  output  are  shown  for  comparison 

In  these  tables  (Xllla  and  b) ,  the  following  numbers 
correspond  to  the  decoded  morse  characters: 

1  -  dot 

2  -  element-space 
3,4  -  letter-space 
5,6  -  dash 

The  letter-space  and  dash  are  represnted  by  two  numbers  since 
such  decisions  may  result  either  from  comparisons  made  on  a 
straightforward  character  versus  character  basis  or  from 
comparisons  made  utilizing  the  modified  likelihood  computation 
previously  described.   In  each  case  the  sequence  ^ . ^— ~  . ~ 
was  transmitted;  Table  XHIb  shows  how  the  Viterbi  algorithm 
corrected  the  thresholded  sequence  (*.*.*..*.-.)    to  form  a 
dash  from  the  inner  .*.    sequence.   This  situation  is  similar 
to  that  shown  previously  in  Figure  23. 
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TABLE  XII 

COMPARISON  OF  VITERBI  OUTPUT  WITH 
SMOOTHED  AND  FILTERED  OUTPUTS 


FILTERED 
SMOOTHED 
VITERBI 


AR  E  AR  AR  UC  AL  AR  AR  E  AR  E  UR  AR  AR 

are  ImarIarare  ARElARAR 
AREARARMRARARAREAN         AR  AR   AR 


FILTERED 
SMOOTHED 
VITERBI 


RR  AR  E  AR  AR  AR  AR  AR  I  AG 

AR  AR    AR  AR  AR  AR  AR  I  AG 
AR  AR    AR  AR  AR  AR  AR    AR 


Note  : 

1.   Sequence  of  AR  at  35  wpm,  5  db  SNR,  tranmitted. 


SUMMARY  OF  VITERBI  OUTPUT: 

New  errors  made 
Errors  uncorrected 
Corrections 
Net  improvement 


2 
2 

4 
2 


97 


»-»  J-  vO  o 


>044 


W  vO  -*  -*  nC\^-  -4-  -^ 

Q 

H 


w 

EH        ifj-^vONOvOVf^*" 

H 

> 


H       .^  cu  vO  cu  cu  cu  cu 

H 
H 
X 


>  *-•  CU  00   -:*-  U0   vO 

or 

to 


O  vfl  -*  -*  o  o 

c»  vo  r^  r^  o>  0") 

o  o  o  o  o  o 

^*-  ^t  -4-  -*-  -^  <r 


O  -* 

•*■  o  %t 

if 

•4- 

id  in 

•* 

in 

in  in 

•*-* 

i 

r^  i^ 

0O 

r^ 

r-v  r^ 

\ 

o  o 

o  o  o  o 

\ 

■*  4- 

4- 

* 

-a-  4- 

\ 

in  co 

C1 

oi  in  in 

01  00 

/ 

ro 

n 

12.7 

07.1 

00 
O 

00 

(V'  OJ 

23 

/ 

OJ  OJ 

CVJ 

OJ  OJ 

O 

/ 

H 

/ 

^-  r- 

r^ 

oo 

in  o 

E-i 

00  CU 

in  OJ  CU 

ru 

OJ 

r^  <f 

O 

o 

oo  ro 

rtj 

\ 

H 

\ 

vO  00 

vH 

r» 

o>.  vo 

O 

1 

i 

CD 

•.-t 

o 

o 

Oh 

\ 

OJ 

CVJ 

ai 

S 

\ 

O 

\ 

vO   00 

<f 

in 

vD  vO 

U 

r-  -s- 

vC  vO  v£> 

-j- 

<r 

CU  00 

IN 

«-HI 

CU  CU 

« 

f>.  in 

O  vO 

r-  i^ 

W 

o 

*-< 

o 

o  o 

Q 

OJ 

0J 

OJ  OJ 

o 

(J 

o>  cr. 

1/ 

C\ 

o  a\ 

m  m  *-<  m  in  io 
o  o  «-«  o  o  o 

•4-  -d-  -3-  -*•  -a-  <f 

o  ai  O1,  oi  o  o 

O  v&  00  00  o  o 

m        <         t         '  r 

in  cu  oo  ro  lo  in 
o  o  o  o  o  o 
4  •*  ^  ^  *  •*• 

nvomccNO 

vO  -*   OJ  00  00  o 


00  <-• 

in 

m  oo 

in 

o  o 

o 

o 

OJ  -* 

ai 

cu 

oi  4- 

00 

■r-i 

CI  01 

i>  oi 

WNN 

r- 

o  cu  in  oo 

o 

o 

«-« 

O 

«-« 

m-i 

OJ 

CU 

cu 

0J 

vO   -4" 

•«-l 

cu 

m 

-4- 

m  cu 

4- 

vO 

r^ 

cu 

(/)  OJ  *-t 

01  00 

r-  cu 

I 

o 

o 

o 

k- 

cu 

cu 

cu 

(0 

iT 

00   «-l 

00 

oo 

00 

oo 

us  o  ro 

«Q 

o 

o 

o 

• 

in 


or  o 
<l>  cu 
> 

or 

CO 


•*-«   «-<    «!"< 

O  O  O 

OJ  (U  (U 


cu  oo  -*  m  so 


o  o  o  o  o  o 

o  o  o  o  o  o 

o  o  o  o  o  o 

o  o  o  o  o  o 

cu  cu  cu  cu  cu  cu 

o  o  o  o  o  o 

o  o  o  o  o  o 

o  o  o  o  o  o 

o  o  o  o  o  o 

CU  OJ  OJ  CU  CU  OJ 

o  o  o  o  o  o 

o  o  o  o  o  o 


o 

o 

o 

» 

C) 

o 

o 

CD 

o 

o 

o 

CU 

ru 

cu 

OJ 

cu 

00  cu 

01 

o 

m 

o 

vO 

oo 

vO 

o 

in 

CD 

CO 

O  00 

o 

o 

o 

cu 

0J 

O  O  01  o  o  o 

O  O  If)  o  o  o 


o  o  o  o  o  o 

O  O  CD  o  o  o 

e      ©  ©      •      •  <p 

o  o  o  o  o  o 

o  o  o  o  o  o 

CU  OJ  OJ  CU  CO  cu 

O  O  O  CO  O  CO 

O  O  O  vO  o  *-* 


o 

o 

o 

o 

r-t 

o 

o 

o 

o 

CU  OJ 

aj 

OJ 

o  o  r^  o  o 

o 

oom 

o 

o 

o 

o 

t 

•H 

o 

o 

o 

o 

o 

o 

o 

cu 

cu 

cu 

cu 

nO 

vO 

CI 

o 

0\ 

<ry 

in 

00 

r>. 

o 

^r 

O 

in 

o  in 

c 

o 

o 

cu 

ru 

o  o  o  o  o  o 

CO 

o 

o 

vO 

o 

o 

o 

o 

(D 

o 

1 

•* 

o 

CD 

o 

CM 

o 

o 

CD 

o 

I 

cu 

cu  cu 

cu 

►  -« 

_J 

i  d 

«-« 

ai  o 

<« 

in 

^n 

V 

UJ 
Ci  «J  -* 

Ul    ^    -r-» 

O  UJ  OJ 

CU  ~ )  vO 

U  C3  CU 

UJ  UJ  «-• 

O  CO  cu 


o  i  ^*-  c  o  o 

o           o  o  o 

Ovj           cu  a;  ro 

_T 

►-  01 

o  o  o  o  o  o 

CO  oo 

o  o  o  o  o  o 

~Z  00 

\jj   • 

O  O  O  O  O  CD 

_» r^ 

o  o  o  o  o  o 

CU  CU  OJ  OJ  cu  cu 

UJ 

u 

0.   O  O  vO 
to  ^         ^ 


o  o  o  o 

-3-        cu 


id 
or 
< 
i:  o  o  o  ^*- 


o  cu  o 


98 


H   -4"  CU  vO  CU  CU  CU  CU 
X 

H 


9 


Eh  oo  co  «-«*-«■«-«  co  oo 


C/)OJCUvOOJOJOJOJ 
UJ 


UJ 

z> 

a 

e/> 


a. 

CD 

> 
> 


cu  ■>-*  cu  cu  oj  oj 
\ 


*-•  oj  co  .*  ir>  vo 


OJ  -S-  «-•  «-f  OJ  OJ 

p*>  (Tv  h-  h*  oj  en 
o  r^  oo  oo  o  o 

«-«   O    O    O    «-•    <rH 

-*   -*-   -*   -*   -=f   -^ 

en  oj  en  en  en  o^ 
r^  oj  en  r^  r>>  r-v 

00  00  oo  oo  oo  oo 
o  o  o  o  o  o 

-3-     ^     -*"     -^     4*"     -*" 

in -t  «h  «h  en  (Ti 

•   •    »   »    •    » 

oc  oo  en  en  oc  oc 
o  o  o      o  o 

^-  OJ  OJ         -3-  -*" 
O  vO  ^*    -t  xO  vC 

en  r^  en  en  in  in 

Nr^  oC  oONf^ 

o  o  o  o  o 

OJ  OJ  OJ  OJ  OJ 

-3"  00  «-«*-«  -3"   -3" 
0C  vO   -=J-   -*   00  00 

r^  •&  r^  r-^  r^  r^ 
o       o  o  o  o 

OJ         CU  CU  CU  CU 

co  oj  o  en  oo  *-# 

oo  o  co  co  *h  o 

\O(V)(r\N0O>£) 

*-«       o       o 

OJ         OJ 

en  co  co  co  o  o 

|S  C>   vC    O   H  H 

•     ••••• 

o  in  in  in  en  en 
«-*      o  o  o  o 

(U  OJ  OJ  OJ 

OC  O  Oj  to  CO  in 

4--*   N-*  WW 

o 

OJ 
OJ  xO  OJ  OJ  OJ  OJ 

-*  en  Is*  r»  -*  -^ 

00  0J  CO  CO  00  00 

o       o  o  o  o 

OJ         CU  CU  OJ  OJ 

t^  oj  co  cu  en  -3- 

LO  ■&   O  >0  *-*  OJ 

(OOJ^NfOio  W 

X       o       o       o 

I—         OJ  OJ         OJ 

o 

Z  00  -r-»  0-\  00  00  tX> 
UJ  O  CO  en.  o  o  o 
_!•••••• 

cr  o  o  o  o 

CO  CU  OJ  OJ  OJ 

> 


o  o  o  o  o  o 

o  o  o  o  o  o 

CO  o  o  o  o  o 

o  o  o  o  o  o 

CU  OJ  Oo  CU  0J  OJ 

o  o  o  o  o  o 

o  o  o  o  o  o 

o  o  o  o  o  o 

o  o  o  o  o  o 

CU  OJ  CU  OJ  OJ  OJ 

o  o  o  o  o  o 

o  o  o  o  o  o 


o  o 

o 

1    O  CO 

o  o 

o 

o  o 

OJ  OJ 

CU 

OJ  OJ 

<*•  in 

o 

o  o  o 

o  t^ 

o 

o  o  o 

o 

o  o  o 

o 

o  o  o 

CU 

oj  oj  eu 

o  o 

o 

o  o  o 

o  o 

o 

o  o  o 

•      • 

• 

•      •      • 

O    t 

o 

o  o  o 

o 

o 

o  o  o 

OJ 

CU 

OJ  OJ  CU 

«-»    «~f 

CU 

O  CU  o 

•r-t  en 

G\ 

o  *-*  o 

•r-4 

•€-* 

oaio 
o      o 

CU         CU 

OJ  OJ 

o 

o  o  o 

vO  CU 

o 

o  o  o 

«-» 

o 

o  o  o 

o 

o  o  o 

CU  CU  CU  CU 

-*  in 

v£j 

en  in  r- 

co  en  ■=*• 

«-<  CO  CO 

CU 

t-i  eu  cu 

o  o  o  o  o  o 
o  o  o  o  o  o 


O    t 

o 

CU 

o  o  o  o 
o  o  o  o 

cu  cu  cu  eu 

00  -3" 

in  o 

cu  o  in  o 

40(T\0 

r* 

CO  o  CU  o 

o      o 

CU       cu 

O   O 

o  o 

«-•  o  o  o 

en  o  o  o 

o 

(DO  I    CU  O  C  O 

CD  O  O  O  O 

x  cu  oj  cu  eu 


> 

or 
z> 
to 


«-♦  oj  eo  -s-  in  no 


UJ 


UJ 

Q  U  ^- 

UJZ.H 

O  UJ  cu 
CD  ~~i  O 
CJ  C  CU 
UJ  UJ  «-• 

now 


x 

CO  o 
Z  ** 
UJ    * 

_j  en 


UJ 

u 
<c 

fJL    CU 

c/>  -3- 


11  O  4- 


OC  o  o  o  o  o  o 
co      cu       -a-       eu 


o  oo  o  cu  o  o  o 

4*  U'l         •* 


cu  en  -&  in  -o 


99 


VII.   PRE-DETECTION  MODEL  AND  FILTER 

Since  it  is  assumed  that  the  receiver  has  been  tuned  to 
the  signal  carrier  frequency,  it  is  sufficient  to  model  the 
signal  as  one  of  known  frequency  and  unknown  amplitude  and 
phase  of  the  form  A  sin(cot+8)  .   The  received  signal  then  is 
of  the  form 

z(t)  =  A,sin(cot+9)  +  v(t) 

where  v(t)  represents  additive  white  gaussian  noise.   A  state 
model  of  the  signal  process  may  be  obtained  by  rewriting  the 
transmitted  signal  in  the  form   a  sin  cot  +  b  cos  cot   [4], 
Letting  x,  represent  the  discretized  signal  in  this  form,  the 
following  state  model  results: 


x^k+1) 


x2(k+l) 


-COT 


COT 


x1(k) 


x2(k) 


where 


x~(t)  =  b  cos  cot  -  a  sin  cot 

k  =  time  index 

t  =  sampling  interval 
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The  observation  model  then  is 


z(k)  =  [  1    0  ] 


x1(k) 


x2(k) 


+  v(k) 


This  model  may  be  written  more  compactly  in  vector 
notation: 

x(k+l)  =  $(k)  x(k) 

z(k)  =  H(k)  x(k)  +  v(k) 

where  $_  is  the  state  transition  matrix  and  H  is  the  measurement 
vector.   The  on-off  keying  nature  of  the  signal  may  be 
accounted  for  in  an  intuitive  way  simply  by  multiplying  the 
observed  value,  z(k),  by  the  probability  that  the  signal  is 
present.   This  probability  is  readily  obtained  from  the 
demodulated  output  of  the  filter  by  using  the  algorithm 
previously  derived  for  mark  and  space  transition  probabilities 
for  the  baseband  signal. 

B.   FILTER  ALGORITHM 

The  general  filter  algorithm  presented  in  Appendix  A, 
using  the  above  signal  model,  was  used  to  filter  the  (down- 
converted)  IF  signal.   Demodulation  was  accomplished  digitally 
by  squaring  and  averaging  the  x.  state  estimate.   The 
subroutine  used  previously  for  the  calculation  of  Q  was  then 
used  in  exactly  the  same  way  as  for  the  baseband  model  except 
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that  the  indices  k  and  j  were  advanced  by  an  amount  of 
time  equal  to  the  delay  due  to  averaging  in  the  demodulation 
process.   Additionally  it  was  found  that  using  zero  proba- 
bility during  space  intervals  was  too  low  to  allow  recovery 
when  the  signal  pulse  occurred.   The  probability  0.5  was 
found  to  be  sufficient  and  was  used  whenever  zero  probability 
would  normally  have  been  called  for. 

C.   IMPLEMENTATION  AND  RESULTS 

This  filter  was  programmed  and  tested  using  test  signals 
of  -2  dB  though  +2  dB  SNR  in  a  2  kHz  bandwidth,  and  -15  dB 
through  -11  dB  in  a  2  kHz  bandwidth  with  10  0  Hz  bandpass 
filtering  prior  to  sampling.   In  order  to  determine  the 
effectiveness  of  modifying  z(k)  by  the  probability  as  des- 
cribed above,  the  filter  was  also  run  with  the  probability 
set  to  1.   The  signal  was  sampled  at  4000  samples  per  second, 
the  (down-converted)  carrier  frequency  was  1000  Hz,  and  the 
modulating  signal  was  a  square  wave  with  period  equivalent 
to  a  code  speed  of  25  wpm.   Because  of  the  lengthy  processing 
time  (1  second  of  data  required  about  30  seconds  of  processing 
time) ,  no  large  sample  error  rates  as  such  were  obtained. 
However,  as  can  be  seen  from  the  output,  Figures  24  through 
31,  the  filter  performed  well  on  signals  of  SNR  -1  dB  and 
above  (2  kHz)  and  -14  dB  and  above  with  100  Hz  pre-f iltering . 

Figures  24  through  27  are  typical  examples  of  the  test 
run  made  using  the  straightforward  filter  with  no  modification 
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of  the  observed  signal.   In  these  figures  channel  1  is  the 
input  signal,  channel  2  is  the  filtered  signal,  and  channel 

3  is  the  demodulated  output.   Figures  24  and  25  are  the 
results  obtained  from  the  signal  in  the  2  kHz  bandwidth; 
Figures  26  and  27  show  the  results  of  100  Hz  analog  bandpass 
filtering  prior  to  sampling. 

Figures  2  8  through  31  are  the  outputs  of  the  processor 
using  the  modified  observation  model.   Channel  1  is  the 
input  signal;  channel  2  is  the  input  multiplied  by  the 
probability  obtained  from  the  transition  probability  estima- 
tion algorithm;  channel  3  is  the  filtered  signal,  and  channel 

4  is  the  demodulated  output.   The  input  signals  were  the 
same  as  those  shown  in  Figures  24-27. 

Table  XIV  presents  the  results  of  a  bit  error  rate 
analysis  made  on  a  sample  size  of  approximately  100  bits. 
Since  the  test  signal  was  not  morse  code,  no  letter  error 
rates  were  obtained.   The  projected  letter  error  rates 
shown  in  the  table  were  determined  simply  by  multiplying 
the  bit  error  rate  by  10  since  this  is  approximately  the 
proportionality  factor  between  these  two  error  rates,  as 
can  be  seen  from  Tables  III-VI. 

Based  on  this  limited  data,  the  conclusion  may  be  tenta- 
tively drawn  that  a  processing  scheme  employing  100  Hz 
analog  filtering  followed  by  discrete  optimum  linear  filtering 
and  detection  will  yield  acceptable  decoded  error  rates  on 
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TABLE  XIV 
ERROR  RATES  FOR  PRE-DETECTION  FILTERING 


it  Error 

Rate 

Projected  Letter 

(%) 

Error  Rate 
(%) 

0 

0 

0 

0 

0 

0 

1 

10 

2 

20 

(a)   No  100  Hz  BP  Filter: 


SNR 

(2  kHz) 

(dB) 

2 

1 

0 
-1 
-2 


(b)   With  100  Hz  BP  Filter 


SNR  Bit  Error  Rate         Projected  Letter 

(2  kHz)  (%)  Error  Rate 

(dB)  (%) 


-11  0  0 

-12  0  0 

-13  0  0 

-14  1  10 

-15  1  10 


NOTE:   Rates  are  based  on  small  sample 
size  of  approximately  100 
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signals  of  SNR  as  low  as  -14  dB  in  a  2  kHz  bandwidth. 
Smoothing  of  the  state  estimates  at  this  processing  stage 
would  probably  yield  additional  gain  although  an  additional 
penalty  in  processing  time  would  be  incurred. 

Although  this  scheme  meets  the  design  objectives 
specified  for  the  processor,  it  is  probably  unrealistic  to 
assume  that  such  processing  could  be  implemented  in  real 
time  on  any  existing  machine  without  parallel  processing. 
Coding  efficiency  could  undoubtedly  be  improved  but  the 
inherent  number  of  multiplications  involved  in  the  filter 
algorithm  would  eventually  limit  the  processing  speed. 
One  possible  alternative  is  to  down-convert  the  received 
signal  to  the  0-100  Hz  band,  and  with  a  100  Hz  low-pass 
filter  in  place,  sample  at  200  samples/sec.   With  such 
filtering,  the  processing  described  above  would  be  feasible, 
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VIII.   CONCLUSIONS  AND  RECOMMENDATIONS 

A.   CONCLUSIONS 

The  results  of  the  various  processing  schemes  considered 
in  this  investigation  lead  to  the  following  definite 
conclusions . 

1.  Kalman  filtering  of  the  demodulated  morse  signal 
provides  at  least  a  50%  reduction  in  letter  error  rate  over 
unprocessed  letter  error  rates  of  approximately  60%  or  less. 

2.  Smoothing  of  the  demodulated  signal  provides  a 
reduction  in  letter  error  rate  of  approximately  30%  over 
filtering  alone,  resulting  in  an  overall  reduction  of  65% 
over  the  unprocessed  error  rate. 

3.  Viterbi  decoding  of  the  morse  characters,  using  the 
smoothed  state  estimate  for  likelihood  computation  and  using 
a  first  order  Markov  model  of  the  code  to  obtain  transition 
probabilities,  provides  a  further  significant  reduction  in 
error  rate  if  the  input  error  rate  is  on  the  order  of  10% 

or  less.   For  input  error  rates  larger  than  10%,  Viterbi 
decoding  is  of  little  value. 

4.  In  almost  all  cases,  the  processor  performed  better 
on  sloppy  code  and  typical  sequences  than  on  perfect  code 
and  AR  sequences.   This  behavior  is  to  be  expected  since  the 
statistics  of  the  input  signal  should  match  those  for  which 
the  processor  was  designed  in  order  to  achieve  optimum 
performance . 
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5.  By  using  a  100  Hz  bandpass  filter,  pre-detection 
Kalman  filtering  allows  recovery  of  the  code  with  a  resulting 
error  rate  of  about  10%  or  less  for  signals  whose  SNR  in  a 

2  kHz  bandwidth  is  -14  dB  or  higher. 

6.  The  Pickering  230-D  decoder  (see  Appendix  C)  allows 
recovery  of  the  code  with  a  resulting  error  rate  of  about 
10%  or  less  for  signals  whose  SNR  in  a  2  kHz  bandwidth  is 
approximately  -6  dB  or  higher,  also  by  using  a  100  Hz 
bandpass  filter. 

By  making  reasonable  extrapolations  to  various  other 
processing  arrangements  based  on  the  results  presented  here, 
the  projected  performance  of  several  alternative  processors 
may  be  obtained  with  a  high  degree  of  confidence.   The 
processing  arrangements  presented  in  Table  XV  are  listed  more 
or  less  in  order  of  increasing  complexity  and  power,  showing 
the  letter  error  rates  to  be  expected  from  each;  the  projected 
figures  are  indicated  by  an  asterisk.   The  rates  presented 
assume  that  the  processors,  except  for  the  human  operators, 
are  preceded  by  a  100  Hz  bandpass  filter. 

Since  no  measurements  were  made  for  SNR's  above  -6  dB , 
except  for  the  Pickering  2  30-D,  the  projected  rates  in  the 
-4  dB  column  were  all  determined  by  extrapolation  of  the 
measured  values.   The  projected  values  for  coherent  demodula- 
tion (row  6)  are  based  on  the  presumption  that  such  demodula- 
tion would  provide  approximately  3  dB  of  processing  gain  over 
non-coherent  demodulation;  the  subsequent  values  for  Kalman 
filtering,  smoothing,  and  Viterbi  decoding  (rows  7-9)  were 
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TABLE  XV 

PERFORMANCE  OF  ALTERNATIVE  PROCESSING  SCHEMES 

SNR  (in  2  kHz)   ((B) 
Processor        -15     -14     -13     -10      -7      -4 


10 ; 


1. 

Non-coherent 
demodulation 

>50 

>50 

>50 

>50 

35 

2. 

(1)  followed  by 
Kalman  Filter 

>50 

>50 

>50 

>50 

15 

3. 

(1)  followed  by 

snnoothing 

>50 

>50 

>50 

>50 

9 

4. 

(3)  followed  by 
Viterbi  Decoder 

>50 

>50 

>50 

>50 

3 

5. 

Pickering  230-D 

>50 

>50 

>50 

-50 

15 

6. 

Coherent 
Demodulation 

>50* 

>50* 

>50* 

35* 

10* 

7. 

(6)  followed  by 
Kalman  Filter 

>50* 

>50* 

>50* 

15* 

5* 

10.  Pre-detection 
Kalman  Filter 

20* 

10 

1L  (10)  followed  by 
Viterbi  Decoder 

15* 

4* 

12. Typical  Operator 

? 

? 

13. Good  Operator 

• 

• 

5* 


1* 

7 
5* 

3* 


8.  (6)  followed  by     >50*     >50*     >50*     10*      3*      2* 
smoothing 

9.  (8)  followed  by     >50*     >50*     >50*      4*      2*      1* 
Viterbi  Decoder 

5*      0*      0*      0* 


2*      0*      0*  0* 

?       ?      10*  5* 

10       5       1  0* 

Letter  error  rates  (%)   *Projected 
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obtained  by  applying  the  respective  improvement  ratios 
actually  obtained  for  non-coherent  demodulation.   In  the 
case  of  the  pre-detection  Kalman  filter  (row  10) ,  a  10%  error 
rate  was  actually  obtained  for  the  -15  dB  entry,  and  no  errors 
were  obtained  for  the  -13  dB  entry.   However,  since  the  small 
sample  size  tends  to  decrease  the  confidence  in  these  figures, 
these  rates  were  increased  on  a  subjective  basis  by  observing 
the  quality  of  the  output  signal.   Again  the  subsequent  rates 
for  Viterbi  decoding  (row  11)  were  obtained  by  applying  the 
previously  determined  improvement  ratio.   The  figures  for 
the  human  operators  are  the  author's  estimate  based  on  the 
error  rates  obtained  previously  for  the  amateur  radio 
operators.   A  degradation  factor  of  3-6  dB  should  probably 
be  added  to  the  SMR's  shown  for  typical  field-operation 
performance . 

In  summary  it  may  be  concluded  that  the  performance  of 
a  good  operator  can  be  approached  by  a  processing  scheme 
employing  pre-detection  100  Hz  bandpass  filtering  followed 
by  discrete  Kalman  filtering  and  a  Viterbi  decoder.   The 
performance  of  a  typical  operator  can  be  obtained  by  either 
the  2  30-D  or  by  coherent  demodulation  preceded  by  100  Hz 
bandpass  filtering,  with  further  improvement  provided  by 
Kalman  filtering,  smoothing  and  Viterbi  decoding. 

B.   RECOMMENDATIONS 

A  more  appropriate  model  for  the  demodulated  baseband 
signal  would  be  one  which  incorporates  the  exponential 
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rise-times  and  fall-times  of  the  signal  pulses  instead  of 
the  abrupt  rise-times  and  fall-times  as  used  here.   A  filter 
incorporating  such  a  model  would  probably  have  the  effect 
of  reducing  the  errors  caused  by  extremely  short  dot 
insertions  during  letter-spaces  and  word-spaces.   Better 
estimators  for  received  demodulated  signal  noise  power  and 
for  character  duration  mean  values  and/or  probability 
densities  should  be  tested,  although  it  is  felt  that  little 
advantage  would  be  gained  from  more  sophisticated  techniques 
in  an  actual  operational  environment.   A  third  (or  higher) 
order  Markov  model  of  the  code  would  undoubtedly  show  a 
significant  improvement  over  the  first-order  model  in  the 
effectiveness  of  the  Viterbi  decoder  at  sufficiently  low 
input  error  rates.   Such  Markov  modeling,  along  with  improved 
likelihood  calculations,  deserves  further  investigation. 

The  pre-detection  Kalman  filter  shows  the  greatest 
advantage,  and  more  investigation  of  such  filtering,  and 
possibly  smoothing,  with  the  goal  of  making  the  processor 
real-time,  should  be  undertaken.   Down- conversion  of  the  IF 
signal  to  100  Hz  or  so  followed  by  a  100  Hz  bandpass  filter, 
and  sampling  at  200-400  samples/sec,  may  be  the  solution. 
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APPENDIX  A 
THE  DISCRETE  KALMAN  FILTER 

The  discrete  Kalman  filter  is  an  extension  of  the  more 
familiar  Wiener,  minimum  mean-square-error,  matched  filter 
to  nonconstant  coefficient  multivariable  systems  with 
nonstationary  noise,  implemented  in  sequential,  or  recursive, 
form.   The  result  of  every  processing  cycle  is  the  current 
estimate  of  the  state  under  consideration.   As  each  new 
observation  is  made,  the  current  estimate  is  updated  to 
reflect  the  information  content  of  this  new  measurement. 
A  brief  outline  of  the  derivation  of  the  filter  algorithm 
is  presented  below. 

The  message  model  is  described  by  the  linear  vector 
difference  equation: 

x(k+l)  =  £(k)x(k)  +  T(k)w(k) 

where  the  input  noise,  or  random  forcing  function,  w  is  a 
zero-mean  white-noise  process,  with  covariance 


cov[w(k)  ,w(j)  ]  =  Q(k)6k(k-j) 


The  observation,  or  measurement,  model  is  given  by  the  linear 
algebraic  equation 
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z(k)  =  H(k)x(k)  +  v(k) 

where  v(k)  is  also  a  zero-mean  white-noise  process,  with 
cov[v(k),v(j)]  =  R(k)6k(k-j)  . 

For  simplicity,  it  is  assumed  that  w  and  v  are  uncorrelated, 
and  that  w  and  the  initial  value  of  x  are  uncorrelated. 

The  first  step  in  obtaining  the  estimate  at  time  k  is 
to  predict  ahead  from  the  estimate  obtained  at  time  k-1. 
This  prediction  may  be  expressed  as  the  conditional 
expectation: 

x(k|k-l)  =  E[x(k)  |z(k-l)  ] 

But  since  the  measurement  z_(k-l)  is  embedded  in  the  previous 
estimate,  x(k-l|k-l),  this  prediction  may  be  expressed  as 

x(k|k-l)  =  _£x(k-l|k-l)  +_TE[w(k-l)]   . 

Since  E[w(k)]  =  0,  this  reduces  to 

x(k|k-l)  =  ^x(k-l|k-l)  . 

The  estimate  at  time  k  may  then  be  determined  by 
considering  it  to  be  a  summation  of  this  prediction  plus 
a  correction  term  employing  the  measured  value: 
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x(k|k)  =  $x(k-l|k-l)  +  G(k) [z(k)  -  z(k|k-l) ]  (A-l) 

where  z_(k|k-l)  is  determined  as  follows: 

£(k|k-l)  =  E[z(k) |z(k-l) ] 

=  E[(Hx(k)  +  v(k)) |z(k-l)] 

=  E[Hx(k) |z(k-l) ]  +  E[v(k) |z(k-l) ]   . 

Under  the  given  assumptions,  this  reduces  to: 

z(k|k-l)  =  H  E[x(k) |z(k-l) ] 
=  H  1  x(k-l|k-l) 

The  filter  equation  (A-l)  then  becomes: 

x(k|k)  =  j>x(k-l|k-l)  +  G(k)  [z(k)  -  H$x(k-l|k-l)  ] 

where  G(k)  for  optimum  filtering  is  yet  to  be  determined. 

It  is  desired  to  determine  G(k)  such  that  the  resulting 
estimates  are  optimum  in  a  minimum  mean-square-error  sense. 
Since  the  error  in  the  estimate  is  given  by: 

x(k)  -  x(klk)  , 
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the  covariance  matrix  of  estimation  error  is 


V(klk)  =  E[(x(k)  -x(klk))  (x(k)  -x(k|k))T] 


Minimizing  a  scalar  quadratic  form  based  on  this  matrix 
will  yield  the  optimum  gain  G(k) .   Derivations  are  available 
in  several  texts  [4],  [11],  and  will  not  be  presented  here. 
The  optimum  gain  results  in  the  following  algorithm  for  the 
discrete  Kalman  filter. 

* 

Gain: 

G(k)  =  V(k|k-1)  HT  [H  V(k|k-1)HT  +  R]"1 

Estimation : 

x(k|k)  =  x(k|k-l)  +  G(k)  [z_(k)  -Hx(k|k-1)] 

Estimation  variance: 


V(k|k)  =  [I  -  G(k)H]  V(k|k-1) 


Prediction  variance: 


V(k+l|k)  =  <j)  V(k|k)<})T  +  Q(k) 


Prediction : 


x(k+l|k)  =  ^  £(k|k) 
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APPENDIX  B 
THE  VITERBI  ALGORITHM 

An  instructive  and  informative  description  of  the 
Viterbi  algorithm  is  presented  in  [8];  the  following  outline 
is  based  on  this  article.   The  MAP  sequence  estimation 
problem  previously  stated  in  Section  VI. A.  is  formally  the 
same  as  the  problem  of  finding  the  shortest  path  through  a 
certain  graph,  called  a  trellis  diagram.   In  this  diagram, 
illustrated  in  Figure  31,  each  node  corresponds  to  a  distinct 
state  of  the  Markov  signal  process  and  each  branch  represents 
a  transition  to  some  new  state  at  the  next  instant  of  time. 
In  this  representation,  every  possible  state  sequence 
corresponds  to  a  unique  path  through  the  trellis. 

Each  branch  is  assigned  the  length 

X(ck)  =  -In  p(xk+1IV   -  m  puk|ck) 

where 

C,   represents  a  transition  from  x,  to  x,  ,  . 

The  P(x,  ,jx,)  are  the  sequence  transition  probabilities 
while  P(z,  |ck)  are  the  likelihoods  of  a  particular  state. 
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The  algorithm  for  determining  the  shortest  path  through 
the  trellis  diagram  is  a  version  of  forward  dynamic 
programming  and  is  stated  as  follows: 

M  =  number  of  states;  K  =  length  of  input  sequence 


1.   STORAGE 
k 


(time  index) 


x(xk) ,  1  <  xR  <  M 


(survivor  terminating  in  x,) 


£ (xk)  ,  1  <  xk  <  M 


(survivor  length) 


2.   INITIALIZATION: 
k  =  0 


x(x  ) =x   ,  x(m)  arbitrary,  m  ^  x 


r_(xo)=0;  T(m)  =  »,  m  ^  xq 


3.   RECURSION: 
a.   Compute: 


IUk+1,xk)  4  I(xk)+A(ck)  , 


for  all  Ck  ; 


b.   Find: 


r(xk+1)  =  min  r  (xk+rxk)  , 


for  each  x 


k+1' 


124 


c.   Store  F(x,  ,,)  and  the  corresponding  survivor  sequence 


x(xk+1); 


d.   Set  k  to  k+1  and  repeat  until  k  =  K. 

As  an  example  [8],  the  recursive  determination  of  the 
shortest  path  through  the  trellis  shown  in  Figure  32  is 
shown  in  Figure  33. 
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k=0 


k=l 


k=2     k=3 


k=4     k=5 


Figure  32.   Trellis  Diagram  with  Assigned  Lengths 
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k  =  l 


k=2 


^ — © •  2 


k=3 


k=4 


k=5 


Figure  33.   Example  of  Viterbi  Algorithm 
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APPENDIX  C 
PICKERING  2  30-D  PERFORMANCE  EVALUATION 

The  Pickering  230-D  is  a  currently  available  automatic 
decoder  and  transcriber  which  includes  some  front-end 
processing.   The  front-end  consists  of  what  is  essentially 
a  type  of  coherent  detection  scheme  with  a  bandwidth  of 
about  180  Hz;  the  center  frequency  of  the  unit  tested  was 
at  875  Hz.   The  letter  error  rate  versus  SNR  of  the  230-D 
was  determined  in  the  laboratory  using  the  model  KB-1 
keyboard  to  send  perfect  code.   The  error  rates  were 
determined  for  both  a  2  kHz  bandwidth  and  a  100  Hz  bandwidth 
and  are  shown  in  Table  XVI.   A  performance  evaluation  of  the 
230-D  for  error  rates  obtained  using  actual  operator- 
transmitted  code  with  no  noise  is  available  in  Ref.  [2], 


128 


TABLE    XVI 
Pickering    230-D  Error   Rates 


SNR  35  wpm  30  wpm  25  wpm 

(in  2  kHz)        2  kHz         100  Hz  2  kHz         100  Hz  2  kHz         100  Hz 

(dB)  (%)  (%)  (%)  (%)  (%)  (%) 


1.6 

1 

3 

1 

0 

0 

0 

0.4 

4 

15 

4 

6 

0 

0 

-0.9 

29 

6 

22 

13 

21 

6 

-2.0 

- 

7 

- 

11 

- 

6 

-4.4 

- 

7 

- 

7 

- 

4 

-6.4 

- 

15 

- 

15 

- 

5 

-8.9 

- 

21 

- 

27 

- 

22 

10.5 

- 

60 

- 

78 

- 

61 

12.4 

_ 

_ 

_ 

_ 

_ 

_ 

Notes : 

1)  Sample  size:   Approximately  100  letters  in  each  case 

2)  Perfect  Code 
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COMPUTER    PROGRAMS 


4F8RTRAN 
1 
2 
3 
k 


cccc 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

cccc 

c 


GO 

cccccccccccccccccccccccccccccccccccccccccccccccccccccccc 

c 

THIS  PR°GRAM  I^FLD^ENTS  THE  POST-DETECT  I  ci\    KALMAN  C 

FILTER  AND  LINEAR  SMOOTHER/  ALONG  WITH  THE  REOUlR  C 

SIGNAL,  PARAMETER  ESTIMATOR  ALGORITHMS.   THE  FOLLOWING   C 

UTILITY  SUBROUTINES  ARE  USED:  Z 

BUFFERIN  -  READS  DATA  BN  INPUT  TAPE.  C 

DAL  -  D/A  CONVERSION  AND  OUTPUT  ROUTINE  C 

THE  FOLLOWING  SU3R0JTINES  A^E  PROVIDED!  C 

BACK  -  BACKWARD  FILTER  ROUTINE  C 

STATS-  ESTIMATES  SIGNAL  PA3AVETERS  C 

VARW  -  COMPUTES  THE  VARIANCE  OF  W(K)  C 

C 
INPUT  PARAMETERS  AT  Tl^E  nE  EXECUTION  ARE  : 

INITIAL  ESTIMATE  fjF  t  C 

THE  PARAMETERS  Tl  AND  T2  C 

THE  DOT^DURATION  DENSITY  PARAMETER/  LDOT  C 

ThE  DASH-DURATION  DENSITY  PARAMETER/  DDASH  C 


CCCCCCC.CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC 


r  -  r-r 


REAL 

DIMEN 

DIMEN 

DIMEN 
DIMEN 
DIMEN 
DIMEN 
COMMg 

ITSiTD 
C0MMO 
COMMO 


LDOT/ 

SI  ON 

DION 

SI  ON 

SI9N 

SIPN 

SI  ON 

N/3L0 

S/E^E 

N/3L0 

N/BLO 


MEANX 
XHSMN 
EVARF 

X3B<  1 
IBUF< 
XHATB 
MERIT 
CK1/Y 
ANS/N 
CK2/N 
CK3/T 


1(5 
2(2 
25) 
500 
1(2 
C4j 
NTi 
SHB 

ele 

RAN 


AN/MEANXB/MNX1/MNIX2/MFRIT 
0),XHS^( 150)/XHSMN2< 100)/XHSMD< 1 


50 >/XHATF2( 250) /EVARF (250) 
*P 

)  , 
50 
?, 
XN 
RT 
M/ MERIT 


VAR32( 125)/XHAT32( 125) 
XHATF(250) 

)/PVARBK250)/XB(250)/XH7  (10) 
12) /TRANS (11) 

TC/XHSM/XHS^D/ I  J/ I J1 / I J2/ I JL/  I 


J"</ 


C 
C 


39 


NAMELIST  LDBT/DDASH,T/T.1/T2 
ENTER  TRANSITION  PROBABILITIES  FOR  VITERB1  DECODER 


TRA\: 
TRAN 
TRAN 
TRAN; 
TRAN 
TRAN 
TRAN 
TRAN 
TRAN 
TRAN 
TRAN 
CONT 


S(2)» 

q  (  -a  \  - 


AL0G(0.6S2) 
AL0G( 0*318) 
AL0G(0.5O4 ) 
ALOG( 0.396) 
AL0G(0.25) 
ALOG(0.?5) 


SU)  = 
S(5)« 

5(6)  = 

S(7) »-AL0G(0.25) 

S(8)  = 


5(9)* 
S(10) 
S(ll) 

INUP 


AL0G(0.25) 

A  L  9  G  (  C  .  6  8  k  ) 
-ALOG( 0.316) 
-ALRG(0.1  ) 


INPUT  PARAMETERS 
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52 
53 
54 
55 
56 
57 
58 
59 
60 
61 
6? 
63 
64 
65 
66 
67 
68 
69 
7^ 
71 
72 
73 
74 
75 
76 
77 
78 
79 
80 
81 
82 
83 
84 
85 
86 
87 
88 
89 
90 
91 
92 
93 
94 
95 
96 
97 
98 
99 
100 
101 
102 
103 
104 


ouTPumoi ) 

9UTPIJT(  101) 
INPUT* 101  ) 


•ENTER  T/  Tli  AND  T2 
•ENTER  LD9T  AND  DDASH 


(MSEC) ' 
(MSEC) • 


C 

c 
c 


INITIALIZE  VARIABLES  AND  INDICES 


T  = 
Tl 
A  = 
B» 
X9 
XT 
IX 
KS 
VA 
SI 
SS 
MN 

IM 

JT 
JT 
NE 
IJ 
S^ 
XH 
XH 
IX 
PV 
KI 
G  = 
EM 
XT 
XT 
XT 
DO 
D9 
D8 
ME 
C9 


T/2. 
•11/ 

LOOT 
DDAS 

UTL  = 
D  =  3. 
=  0 

1=KS 
1=VA 
=  52  = 
1"SS 

XI  =M 

1=  IM 
=  JT? 
C2«J 
LFM  = 
■IJl 
Nl-S 
SMJ  = 
SMNl 
N  =  C 
AR  =  E 
ND  =  0 

1.  ; 

IN*. 
Dl  =X 
Cl-X 

A  =  XT 

P  K 

2  K 

2  K 

RTT( 

N  T  I  N 


i     LD0T=LDfiT/2.  ;  DDASH=DDASH/2. 
2.  ;  T2=T2/2. 
/T 
H/(3«*T> 

0.  ;  MEANX3  =  0.b  ;  M,EANX  =  0»5  ;  XT  =  T  ;  I T  =  T 
*T 

2  =  0 

2-1.   % 

.5 

2=.4 

NX2=0»5 

2=ISl=IS2=0 

-JTD=JTD2=10 

TC=1C 

NSM9RT=0 

=  U2=II  =  II1  =  I  12  =  0 

MN2=0. 

XHSM2*0« 

(1)=0.  ;  XHSM\2(1)=0. 

VAR«VARX"0«5 

;  KINDFsO  ;  jind=0  ;  JINDF=0 

XHATP=0»  ;  IXHL*0 
05  ;  XT1=XT2=T 
TD2=3.*T 
TC2  =  T 
C  =  T 
1-1*4 
2=1/2 
3=1*12 

Kl/K2/K3)=Q. 
UE 


1 


INPUT  DATA  FROM  TAPE 

12   CALL  BUFFERIN( 1/ 1/ U'UP/500/ IERR> 
1   IE  (  I  ERR.  EC  1  )  39  T9  1 

G9  T9  ( 1/  111/310/112)/  IERR 
111   D9  99Q  lNDE=l/2 

INDE1=( INDE-1 )*?50+l 
INDE2sINDE«250 

BEGIN  PR9CESSING 

DO  999  INDEX-INDEIj INDE2 
X1=PLPAT( IBUr ( INDEX) )/2**23 
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105 
106 
107 
108 
109 
110 
111 
112 
113 

115 
116 
117 
118 
119 
120 
121 
122 
129 
124 
125 
126 
127 
128 
129 
130 
131 
132 
133 
134 
135 
136 
137 
138 
139 
140 
141 
142 
143 
144 
145 
146 
147 
148 
149 
150 
151 
152 
153 
154 
155 
156 
157 


C 

C 
C 


UNPR9CESSED  OUTPUT/  X0UT1 

xouti=o. 

IF(Xl#GEtMEANX)  XBUT1«1» 

IX  IS  THE  RUNNING  TIME  INDEX 

IXMX+1 

IF(  IX.GT.250)  IX  =  1 

IXN  INHIBITS  SMOOTHING  ALGORITHM  UNTIL  SUFFICIENT 
DATA  IS  OBTAINED  (500  SAMPLES) 

IXN=IXN+1 
IF(IXN«GT»500)  IXN=501 

STORE  INPUT  SAMPLES  IN  REVERSE  ORDER  FOR  BACKWARD 
FILTERING 

IF( IX-GT.125)  XB1*XBB(IX-125)  ;  GO  TO  9 

XBl*XB< IX) 

XBB(  126-IX)=XP(251-IX) 

XB (251- IX) "XI 

CALL  STATS 
VARXF=VARX# 

FORWARD  FILTER  ALGBRITM 

399       GAlNIFspVAR/(PVAR+VARXF) 

EVAR=( 1.-GAINT) *PVAR 

XHAT  =  XHATP  +  GAlNF*(Xl-ME'\NX«XHATP) 

THRESH8LDED  FILTERED  OUTPUT/ X0UT2 

X9UT2=0.  ' 

IF(XHAT»GE»0.  )  X0UT2=1. 
IXHAT=-1 

IF(XHAT»GEtO.     )  IXHAT=1 
KIND»KINDF  ;  JIND*JINDF  ;  IXHL=IXHLF 
T=XT  ;  TD=XTO  ;  LD9T=A*XT  ;  DDASH=B*XTD 
XH*XHAT 
350   CALL  VARw 

QFsQ*(FvEAN**2) 

PVARsEVAR+GF 

KINDF^KIND    l    JINDF=JIND    ;     IXHLFMXHL 

XHATP=XP 


STORE  FORWARD-FILTERED  ESTIMATES  AND  VARIANCES  FOR 

sMoo thing 

EVARFl»EVARF2( IX);  EVARr2(  IX)=EVARF( IX) 
EVARF( IX)=EVAR 
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158 
159 
160 
161 
16? 
163 
164 
165 
166 
167 
168 
169 
170 
171 
17? 
173 
174 
175 
176 
177 
178 
179 
180 
181 
IS? 
183 
184 
185 
186 
187 
188 
189 
190 
191 
192 
193 
194 
195 
196 
197 
198 
199 
200 
201 
202 
203 
204 
205 
206 
207 
208 
209 
210 


XHATF1=VHATF2(  IX) ;  XHATF2(  IX) =XHATF( IX) 
XHATF<  IX)  =XHAT 
351   CALL  BACK 
CALL  VARW 
QSSG* (FMEANB#*2) 
KIND3eKJND  ;  JINDB=JIND  ;  1XHLB=IXHL 

REVERSE  ST8RED  VALUES  FRBM  BACKWARD  FILTER  FOR 
SM98THING 

IM  IX.GT.  125)  XHTB1=XHATB?(  IX-125)  ;  G8  T9  4S2 

XHTP.1  =  XHATB1  (IX) 

XHATB2< 126-IX)»XHATB1 (251- IX) 

492  C8NTINUE 

XHATB1 (251*IX)=XHATBP 

IF(  IX.GT.  125)  PVB1=PVAR32( IX»125)  ;  G^  T8  493 

PV31=PVAR31 (IX) 

PVAR32( 126-IY)=PVARB1(251-IX) 

493  CONTINUE 

PVARB1 (251- IX ) =DVARB 

XHATRP*XP 

PVAR3«EVARB+QB 

SM88THING  ALGORITHM 


(WK**2)/PV51 


WK-EVARFl/( 1.+EVARF1/PVB1) 

EVARS- ( ( 1 .-WK/PVB1 )**2)*EVARF  1 

WBK= (XHTB1/PVB1 ) *EVARS 

IF(  IX. EG. 250)  WBK  =  0. 

XHATS'XHATFl/( 1 # +EVARF1/PVB1 )  +  WBK 

IF(  1XN.LE.500)  XHATS  =  0.  ;  TS*XT  ;  TDS  =  XTD 

AVERAGE  AND  ST8RE  SM8aTHED  ESTIMATE  AT  EACH  POINT  FOR 
USE  LATER  IN  LIKELIH880  COMPUTATIONS 


IIT  = 

111  = 
IF(  I 
I  I  =  I 

IF<  I 

IF(  I 
XHS1 
XHS" 
XMSM 
X^SM 
IIT? 

112  = 
IF(  I 
IF(  I 

113  = 
IF(  I 
XHS2 
XHS!* 


C7 
III 

II. 
1  +  1 
I.G 
I»G 
sXH 
Nl( 
1  =  X 
(IT 
=  0. 
112 
12. 
12. 
113 
13. 
=  XH 
N?( 


5*TS 
+  1 

3T.150) 


111  =  1 


T. 
T. 
Sv 
II 
MS 
1  ) 
67 
+  1 
GT 
GT 
+  1 
GT 
SM 
II 


50)  11=1 

I  I T )  11  =  1 

Nl(  I  I  ) 

>*XHATS 

Ml+(XHATS-XHS1)/(0.75*TS) 

=XHSM1 

*TDS 

.100  112=1 
•  I IT2)  112=1 

.100)  113=1 
N2( I  12) 
2)=XHATS 
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211 
21? 
213 
214 
215 
216 
217 
218 
219 
220 
221 
222 
223 
22  4 
225 
226 
227 
22S 
229 
230 
231 
232 
233 
234 
235 
236 
237 
238 
239 
240 
241 
242 
243 
244 
245 
246 
247 
248 
249 
250 
251 
25? 
253 
254 
255 
256 
257 
258 
25^ 
260 
261 
262 
263 


XHSM?=XHSM?+(XHATS-XHS2)/(0.67*TDS) 

XHSKQ( I I3)=XHSM2 
IJMI1-10 

IF(IJ.LE.O)     IJ=15C+TJ 
IJ1MI1-5-I  IT 
I  F  (  IJ 1  .  L  F.  •  0  )     IJ1»15C+KJ1 
1J2=I 13-5 

IFUJ2.LE.0)     IJ2  =  10C+IJ? 
XSU^=0. 
D9    920    1=2/10 
XSUM*XSUM+XHT(  I  ) 
920      XHT{ I-1)»XHT(  I  ) 
XSU^sXSUM+XHATS 
XHT( 10) ?XHATS 
XSUM=XSUM/10. 
XOUT=0. 
IF  (XSUM.GT*  0.0000001  )    X9ljT*l« 

ESTIMATE    T    AND    TD 

XNT     IS    THE    MARK    DURATION    COUNT 
XNTC    IS    THE    SPACE    DURATION    COUNT 


900 


991 


KND  =  C 

IF( (xeuT-X8UTL) .LE.-0.99)  KND=1  ;  GO  TO  900 
JF(XBUT»GE«  0.99)  NT=NT+1  ;  G9  TO  990 
NT»0 

GO  T9  990 
XNT?NT 
\<T  =  0 

IF(  (XNT.LT»0.5*T1 ) .OR. ( XNT »GT *  6* *T2 ) )  G9  TO  990 
IF(XNT.LE» (3.*T1  +  T2)/?.)  GO  T8  991 
UTD=UTD+1 

IF( JTD.EQ.10)JTD2=0  ;  XTO?  =  XT01 
1F(UTP.EQ.20)  UTD'l 
XTD1=XTD1+(XNT-XT01 )/JTD 
UTD?=UTD2+1 

IF(JTD2.EQ«10>  JTD1=0  ;  XTD1=XTD2 
IF( JTD2.EQ»20)  UTD?=1 
XTD2*XTD2«-(XNT*XTD2)/JTD2 
XTD=XTQ1 

IF(UTD2.GT.UTD1  )  XTD  =  XT02 

IFtXTD.UT- (2.*XT)  )  >TD  =  ?»*XT;  XTD1 =XTD2  =  XTD ; 
1UTD=UTD?=5 


OQ 


0 


GO  TO 

UT=UT+1 

IF(UT.EO.IO) 

IF( JT.EQ.20) 

XT1*XT1+(XNT» 

UT2=UT2+1 

IF(UT?.EQ.10) 

IFUT2.E3.20) 

XT?axT2+(XNT^ 


UT2=0    ; 
UT^l 
XT1 )/JT 

JT*0    ; 

UT2  =  1 

xt?)/ut; 


XT2=XT1 


XTUXT2 
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264 
265 
266 
267 
26? 
26? 
270 
271 
272 
273 
274 
275 
276 
277 
278 
27o 
280 
281 
28? 
283 
28'+ 
285 
286 
287 
288 
28? 
290 
291 
29? 
293 
294 
295 
296 
297 
298 
29? 
300 
301 
302 
30? 
30^ 
305 
306 
307 
308 
30? 
310 
311 
31? 
313 
314 
315 
316 


XTAsXTl 

IF ( JT2.GT.JT)  XTA=XT2 
990   CONTINUE 

IF ( (XOljT-XPUTL) .GE.0.99)     KND«j     ;     G9    T^     1000 

IF(XSUT«LEt0.01)    MTONTC  +  1     ;    GO    TP    1090 

NTC  =  0    ;    GO    T8    1090 
1000    XNTC*NTC 

NTC«0 

IF(  (XNTCLT.0»5«T1  )  .PR*  (  XNTC  GT  »6  .  *T2  >  )     39    Tp     1C90 

IF(XNTC«LEt  (3.*Tl+T2)/2t  )    JTOJTOU    09    TO    1091 

GO    TO    1090 

1091  IF(JTC.EQ.IO)  JTC2=0  ;  XTC2=XTCl 
IF(JTCEQ»20)  JTC  =  1 
XTC1=XTC1+(XNTC-XTC1 >/JTC 
JTC?=JTC?+1 

IF(JTC2«EG.10)  JTC  =  C  ;  XTClaXTC2 

IF<JTC2.EQ»20)  JTC2=1 

XTC2«XTC2+(XNTCXTC2)/JTC2 

XTC=XTC1 

IF( JTC2*GT.JTC)  XTC=XTC2 

SENSE  SWITCH  1  IS  USED  TP  SFLFCT  VITFRbI  DECODER 
QPTI8N  DURING  PROGRAM  EXECUTI8N 

1090  IF(SENSE  SWITCH  1)  1092,1093 

1092  IF(NTCGTt4t#TS)    KNDS1     i    XNTC=NTC    ;    .NTC  =  0 
IF(KND.EQ.l)    CALL    LIKELIHOOD 

1C93  CONTINUE 

XT=(XTA  +  XTO/?. 
X9UTL=XPUT 

OUTPUT  VARIABLES  TO  D/A  ROUTINE  FOR  ANALP3  RECORDING 

TN8RM-XT/100. 

CALL  DAL(Xl/Xr?UTl/X0UT2iXHAT/XHTBl/XHATS^X9jT>VA^Xj 
1QF/GAINF/TN8RM) 
999   CONTINUE 

GO  TO  38 
310   PUTPUT(lOl)  'END  9F  RUN  ;  HIT  *  TO  GP  ' 

INPUT < 101) 

GO  TO  39 


C 

c 
c 

c 
c 

C 

c 

c 

C 


SUBROUTINE  BACK 

THIS  ROUTINE  IS  THE  BACKWARD  FILTER 

INITIALIZE  INDICES  FPR  BACKWARD  FILTER  BASED  ON 
FINAL  VALUES  OF  FORWARD-F ILTEREO  ESTIMATES 

IFdXA'E.l)  GO  TO  4  90 
IF(KINDF.ECNC)  KINDBB0  i     GP  TP  360 
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317; 

318: 

319: 

320: 

32i; 

322! 

323: 

324: 

325: 

326 

327, 

32?: 

329: 

330: 

C 

33i: 

C 

332: 

C 

333: 

334! 

335: 

336: 

337: 

33B: 

339: 

340: 

341: 

342: 

343! 

C 

344! 

C 

345: 

c 

346: 

347, 

c 

34R 

c 

349, 

c 

350 

c 

351 

c 

352 

c 

353 

!  C 

354 

355 

356 

357 

358 

359 

360 

361 

362 

363 

364 

365 

366 

367 

:  C 

363 

:  c 

369 

:  c 

KINDB*XTD-<I\DF 
KINDB»0 
JINDB=0  ;  38  TO 

JINDB«XTD-J1NDF 
JINDB*0 


361 


KINDBSXT-KINDF 
IF(KIN'DBtLT»0) 
IF(KIND3tLT.O) 
360  IF(  JINQF.L'Q.O) 
JINDB^XT-JINDF 
IF(JINDB.LT.O) 
IF(JINDB.LT«0) 
!61   C9NTJNUE 

XMATBP=XHAT  ;  IXHLB*IXHAT 

PVARBSEVAR  ;  VaRX3=VaRX  ;  MEANXB-MEANX  ;  GB  =  GF 

TS"TB  i  TDS=TDR  ;  FMEANS*FMEANB 

FMEANBsFMEAN  ;  T3  =  XT  ;  T03=XTD 

490  C9NTINUE 

FILTER  ALGORITHM 

GAINB  =  PVARB/(PVAR8+VARX8  ) 

EVARBS( l.-GAINB) *PVARB 

XHATB*XHATBP+GAlNB* ( X31*MEANXB-XHATBP ) 

IXHATB»*1 

IF(XHATB.GE«0«     )  IXHM3  =  1 

IXHAT=IXHATB 

491  KIND'KINDB    ;     JIND=JIND3     ;     IXHL=IXHLB 
IXHLLMXHLLB    ;    T  =  TB    ;    TD  =  TDB    ;    LD9T=A«T    ;    DDASi 
XH»XHATB 

450   RETURN 


H=3«TD3 


SUBR0UTINE  STATS 

THIS  SUBROUTINE  CALCULATES  THE  INPUT  SIGNAL  MEAN,, 
VARIANCE/  AND  ESTIMATES  THE  SIGNAL  AMPLITUDE  AND  3\R 


INPUT  MEAN  AND  VARIANCE  CALCULATIONS 

I M  1  =  I  M 1  +  1 

IF( IM1#EQ«500J  1^2=0  ;  VA2*VAl  i    MNX2=MNX1 

IF( IM1.EQ.1000)  IM1=1 

MNXl=MN!Xl-f  (  X1-MNX1  )  /  I  M  1 

VAl=VAl+( (Xl-MEANX)«*2-VAl )/IMl 

IF( !M2.EQt500)  !Ml«0  ;  VAl»VA2  ;  MNXl=MNX2 
IF(IM2.E0»1000)  IM2*1 
MNX2«MNX2+(X1-MNX2)/IM2 

VA2=VA2+((Xl-MEANX)**2-VA2)/Iv2 

MEANX=MNX1 

V  A  *  V  A  1 

IF(  IM,2.GT»IM1  )  MEANX  =  NNX2  ;  VA  =  VA2 

SIGNAL  AMPLITUDE  ESTIMATOR 
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370 
371 
37? 
373 
374 
375 
376 
377 
373 
379 
380 
331 
383 
383 
384 
385 
386 
387 
388 
389 
390 
391 
392 
393 
394 
395 
396 
397 
398 
399 
400 
401 
402 
403 
404 
4  05 
406 
407 
408 
409 
410 
411 
412 
413 
414 
415 
416 
417 
418 
419 
420 
421 
422 


80 


31 


C 
C 
C 

c 

c 
c 
c 
c 
c 
c 
c 


IMX1.L 
IS1  =  I  si 

IF(  151. 
IF(  IS1. 


00)  IS2  =  C  l    52  =  S1 
000)  I S 1 = 1 
)  )/ISl 


JS2=IS2 
IF( IS2. 
IF( IS?. 
S2*52+( 
S  =  Sl 
IF(  IS2. 
30  TO  8 
C9NTINU 


KS1 


,'C 


IFCKSlt 

IF(KS1. 

SS1=SS1 

KS2=KS2 

IF(KS2. 

IF(KS2. 

SS2=SS? 

SS=SS1 

IF(KS2. 

CBNTINU 

FMEAN-S 

IF(FMEA 


E.MEANX)  G8  TO  80 

+  1 

FQ.5 

EQ.l 

Xl-S 

+  1 

EG.500)  IS1«0  ;  31=S2 

FIQ.1000)  IS2*1 

X1-S2)/IS2 

GT.IS1)  S  =  52 

\ 
E 

+  1 
FQ.5 

EQ.l 
+  (X1 
+  1 

EG. 5 
EQ.l 
+  <X1 


00)  KS2«0  ;  SS2=SS1 

000)  KS1  =  1 
-SSI )/KSl 

00)    <S1=0  ;  SSl»SS2 
000)  KS2=1 
-SS2J/KS2 


GT.KS1)  SS=SS2 

r 

-ss 

N.LT.FMIN)  FMEAN*FMIN 


N«ISE  VARIANCE  ESTIMATOR 

VARX*VA-0»9*(FMEAN**2)/4. 

IE( VARX»UE«0. )  VARX =0-0000001 

RETURN 


10 


SUBR8UTINE  VARW 

Q  ESTIMATION  ALGeRITH;' 

KIND  =  TINE  INDEX/  </  Ft>R  MARK  PROBABILITIES 

JIND»TIME  INDEX/  J/  FOR  SPACE  PROBABILITIES 

(FOR  USE  WITH  PRE-D  FILTER/  INITIALIZE  KlMD#JlND  T8  50) 

XPsXHJ  P=1»0 

IF( IXHL.EQ.O)  G?  T8  10 

IF(  (  ( IXHAT-IXHU .GT.O) .AND. ( J  I ND. GT . T -LD9T )  )  JIND  =  0J 
1KIN0=0;  G6  T8  10 

IF(  {  IXHAT-IXHL)  «GTtO)  IXHAT*-IXHAT  ;  XP  =  'X^\ 

IF( ( ( IXHAT-IXHL) .LT.O) .AND. ( K I ND . GT . T-LD9T ) )  JI\0=0; 
1KIND»0;  G0  TO  10 

IF( ( IXHAT-IXHL) tLT.O)  IXHAT»-JXHAT  ;  XP=-XH 

IF  (  IXHAT-EC3.1  J  KI\'D*KIND+1 
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423 
424 
425 
426 
427 
428 
429 
430 
431 
432 
433 
434 
435 
436 
437 
438 
439 
440 
441 
442 
443 
444 
445 
4  46 
447 
448 
449 
450 
451 
452 
453 
454 
455 
456 
457 
458 
459 
460 
461 
462 
463 
464 
465 
466 
467 
46  8 
469 
470 
471 
472 
473 
474 
4  75 


il- 
ia 

13 
14 

17 

18 

20 


IF<  IXHATtEQt-l  )  JlND'jr-D+1  ;  GO  TO  20 
MARK  PROBABILITIES 

XK«KIND 

IF(XK.LE. (T-LD9T) )  GO  TO  11 

GO  TO  12 

G  =  0. 

IF{KIND.F.G«1>  XP«FMEAN/2« 
GO  TO  100 

IF(  (XK.LE.  (T  +  LDC^T)  )  .AND.  (XK.GT.  (T-LDQT)  )  )  GO  TO  13 
GO  TO  14 

PWK01«(T-XK)/(4t*|,DeT)+0»75 
PWKNWt  -  PWKOl 

Q«PWK01*PWKNU  P«PWKOlJ  GO  TO  100 

IF(  (XK«LE«  (TD-DDASH)  )  .AND*  (  XK  •  GE  .  (  T  ■»  LOOT  )  )  )  Q*0O 
1G0  TO  100 
IF( (XK.LE* (TD+DOASH) ) tANDt (XK.GE. (TDfDDASH) ) )  G8  TO  17 
GO  TO  18 

PWK01*<TD-XK)/(2t*DDASH)  +  0.5 
PWKM  =  1.  -PWKOl 

Q«PWK01*PWK.MU  PsPWKOlJ  GO  TO  100 
G=0.25;  GO  TO  100 

SPACE  PROBABILITIES 


XJsJINO  ;  P  =  C5 

IF(XJ«LF. (T-LO0T) )  GO  TO  21 

GO  TO  22 

21  G=0. 

IF(  JIMfJ.EG.l  )  XP  =  »FMEAN/2« 
GO  TO  100 

22  IF ( (XJ.LE. (T  +  LDOT) ) »A\D* (XJ.QE. (T-LDOT)  )  )  GO  TO  23 
GO  TO  24 

23  PWK00*(-XJ/(2«*UD8T)+0»5*{ 1 .  +T/L00T ) ) *  12. /17 . +5. /I  7 . 
PWKN0*1 »*PWKOO 

Q"PWKOO»PWKNOJ  P  =  PWK0O  +  C5;  GO  TO  IOC 

24  IF(  (XJ.LE.  (TD-DDASH)  )  .AND'  (XJ.GE.  (T+LOOT)  )  )  Q  =  OtJ 
1G0  TO  100 

IF( (XJ.LE. (TD+DOASH) ) .AVD* (XJ.GE. (T^-OOASH) ) )     GO    T^    27 
GO    TO    28 

27  PWKOO»<  (-XJ/(2.*DDASH)+0.5* (1 . + TO/DO ASH)  ) )*0. 8+0.2 
PWKNOM .-PwKOO 

Q  =  P.n'KCO*PWK\'0;     P  =  PWK00+0.5J     GO    TO    100 

28  IF<XJ.|_E.5.*T)    0  =  0.     ;    GO    TO    100 
PWK00«25.«T*«2/XJ**2 

PWKNOM  ••PWKOOj     Q=PWKO0*PWKNOi     P=PWK00+0»5 
ICO      CONTINUE 

IF(XK«GT.10«»T)     KlMr:  =  0    ;     0  =  0. '25 

IFCXJ.GT. 10. *T)    JIND=0    ;     0=0.25 

I F  (  P  •  G  T  •  1  • )    P  ■  1  •  0 

IXHL«IXHAT 

RETURN 
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er 

co 

1 : 

2; 

c 

3; 

c 

4i 

c 

5: 

c 

6: 

c 

7: 

c 

R! 

c 

9: 

c 

10; 

c 

11! 

c 

12: 

c 

13: 

c 

14! 

c 

15: 

c 

16: 

c 

17: 

r 

18: 

c 

1?: 

20: 

21: 

2?: 

23; 

2^: 

25: 

26: 

27; 

28: 

29; 

30; 

c 

31: 

c 

32; 

c 

33: 

c 

34: 

35' 

36 

37 

38 

39 

40 

41 

42 

:  c 

43 

:  c 

44 

:  c 

45 

46 

47 

•PILATIQN 

SUBROUTINE  LIKELIHOOD 

THIS  SUBROUTINE  CALCULATES  THE  LIKELIH89DS  OF  EACH 
USING  THE  METH0D  GIVEN  IN  THE  TEXT  OF 


CHARACTER  / 
THE  TRESIS 

MERIT ( l#ljN) 
MERIT (2j 1#N ) 

^ERlT(3i liN) 


MERIT(3#2#N) 


MERIT(4, 1,N) 
MERIT(4i2,N) 


IS  THE  DOT  LTKELlHeSD 

IS  THE  ELEMENT-S3ACE  LIKELIHOOD 

IS  THE  LETTER-SPACE  L  I KEL  IH89  rD  P?R 

C8MPUTATI8NS  MADE  BN  A  CHARACTER  VS 

CHARACTER  BASIS 

IS  THE  LETTER-SPACE  LIKELIH93D  FOR 

COMPUTATIONS  INVOLVING  THREE  SH8RT 

CHARACTERS 

IS  THE  CHAR  VS  CHAR  DASH  LIKELIH89D 

IS  THE  THREE  SHORT  CHAR  DASH  LIKELIHOOD 


1 


REAL  MERIT 

DIMENSION  MERIT (4/ 2/ 12>>X^ERT(3) 
DIMENSION  'XHSM(  150)*XHSMD<  100 ) >EST8RE ( 8 ) 
DIMENSION  MARK(il)>NSPACE( 11) 

C9MM8N/BL0CKl/XNT/XNTC/XHSMiXHSMDiIJi I Jl/ I J2, I JL* I J</ 
1 TS/ TDS/FMEANS^ NSH9RT 
C6MMBN/9LBCK2/NEUEMj MERIT 
COMMON/BLOC<^/MARK#r'SPACE/NCHAR 
NCHAR=NCHAR+1 
MARK(NCHAR) =2.*XNT 
NSPACE(NCHAR) »2#*XNTC 

MAKE  TENTATIVE  DECISIONS  BASED  ON  THRESHOLDED 
SM89THED  OUTPUT 

IF(XNT,LT.0.5)  GO  TO  103 

ir(XNT.GE»2.*Ts)  EDUR-XNTJ  NSH6RT=0;  ESJM=0.; 
1G0  TO  102 

IF( (XNT«LT.2.*TS) .AND* (XNT»GT»0»5) )  EDUR=XNT; 
1G0  TO  101 
03   IF (XNTC.GE.2.*TS)  EDUR*XNTC;  NSH9RT«0;  ESUM=Q.; 
1G0  TO  102 

IF( <XNTCtLT»2»0*TS) .AND* ( XNTC « GT . 0. 5 ) )  EDUR=XNTC 

COMPUTATIONS  FOR  SHORT  CHARACTERS 

01   NELEM=NELEM+J 

NSH9RTsNSH8RT+l 
IF(NSHORT.GT.S)  NSHORT«0 
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ESTO 

esu^ 

IF(\' 
TM1« 

IF(r 
TM2  = 
IF<E 
XME3 
IF(X 
1F(X 
MERI 
XMER 
IF(X 
IF(X 
MERI 
XMER 
IF(x 

IF(V 

MERI 
XMER 
IF(y 

IF(X 

^ERI 


RE(N 
«ESU 

SH8R 

1. 

DURt 

0. 

DUR. 

IT=( 

MERI 

MERI 

T(1j 

IT»( 

MERI 

MERI 

T(?i 

IT=( 

MERI 

MERI 

TUj 

IT«( 

MERI 
T  ( 3  j 


SHORT  )»EDUR 

^+EDUR 

T.3T.3)  E5Jf'  =  E5UM-EST9RE(NSHeRT-3) 

GT.TS)  TM1=2.-(EDUR+T5)/(P.*T5) 

GT.TC5/3. )  TM2«1  •  •  (  TDS-EDUR  )  /(  0«67*TDS) 
XHSM( IJ)/FMEANS+0t5)*TMl*(l»*TM2) 

T.LT.O.)  XMtKlT=0. 

T.GT.l.)  XMERIT=1. 

1/NELEM) =XMERIT 

l.-(XH5v( IJ)/FMEANS+0»5) >*TM1* ( 1 »-TM2 ) 

T.LT.O.)  XMERIT=0* 

T.GT.l.)  XMERIT=1« 

liNELEM) *XMERIT 

XHSM( IJ)/FMEANS+0.5>« ( i.-TMl* ( 1 »-TM2) ) 

T.LT.O.)  XMERITsO. 

T.GT.l.)  XMER IT* 1 ■ 

IjNElEM) =XMERIT 

l.«(XHSM( IJ)/FMEANS+0»5) ) * ( 1 . -TmI * ( 1 . -TM2 )  ) 

T.LT.O.)  XMERIT*0« 

T.GT.l.)  XMERIT»lf 

1/NELEMJ»XMERIT 


MODIFIED  LIKELIHS8D  COMPUTATIONS  F3R  3 
SHQRT  CHARACTERS  IN  SUCCESSION 


OR  MORE 


POO 


IF( 
IF( 

D8 
XME 
1MER 
X^R 
XMR 
TM2 
IF( 
IF( 
X^E 
IF( 
IF( 
MER 
XME 
IF< 
IF< 
MER 
G9 


NSH 
NEL 
200 
RT( 
IT( 
T=( 
T  =  X 
=  1* 
ESU 
T"2 
PIT 
XME 
XME 
IT( 
RIT 
Y^£ 
XME 
IT( 
TO 


3RT.LT. 3)  CO  TO  300 
EM.LT«3)  G3  Te  300 

1  =  1.3 
I )=AMAX( MERIT ( l,l,NELEM-3+I ), 
?.>  l/\ELEM-3+I  )  ) 

lt-XMERT( 1  )  )*(  1 .-XmERT(2) )m ( l.-XMERT<3>  ) 
MRT**0. 33333 

^.LT.TDS)  TV2=1.-(TDS-ESUM)/(C.67*TDS) 

•LT.O.)  TM2*0. 

= (XHSMQ( IJ2)/FMEANS+0t5)*TM2*XMRT 

RIT. LT.O.)  XMERIT=0. 

RIT.GT.l.)  XMERIT=1. 

4i2/NELEM-2)=XMERIT 

= ( 1 .-(XHSMD( I J2  5/FMEANS+0.5) )*TM2*X^RT 

RIT. LT.O.)  XMFRIT=0. 

RIT.GT.l.)  XMERITS1« 

3>2/NELEM-2)=XMERIT 

300 


COMPUTATIONS  FOR  L8NG  CHARACTERS 


102   NELEM=NELEM+3 
IJKcj J-EDUR/3. 
IF(IJK.LE.O)  IJKB15I 
IJL=IJ-(2.*EDUR)/3. 


i+IJK 
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01 
0? 
03 
04 
05 
06 
07 
08 
09 
10 
11 
12 
13 
H 
15 
16 
17 
18 
19 
20 
21 
2? 
23 
24 
25 
26 
27 
.28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 
46 
47 
48 
49 
50 
53 
52 
53 


miJL 
T*1*0« 
IF(EDU 
IF(TMl 
TM2»li 
IF(FDU 
X^ERIT 
IF (XME 
IF (XME 
MERIT( 
XMER1T 
IF (XME 
IF (XME 
MERIT ( 


•UE.O)  IJU=150+IJL 

R»LT#3.*TS)    T^l=?.-(EDUR+TS)/(2.*TS) 
•  LT.OO     TM1*0.     ;     IF(  T^l  -GT.  1  •  )    TM1»1 


OS 
) 


R.LT»T0S)    TM2»1.-(TDS-EDUR)/(0.67«T0 

=  (XHSMD(  IJ2)/FMEANS+0»5)*TM2*(1,*»TM1 

RIT-LT.O.)    XMERIT=0» 

RITtGTtl.)    XMERIT*!* 

4/2/NELEM»2)*XMERIT 

»  (  1  .-(  VHSMD(  I j2)/RMEANS+0.5)  )«TM2*  (  1  t-T-1  ) 

RIT«LT.O.)    XMTRIT=0. 

R  I  T.GT.l.)    XMERIT=1» 

3*2/NELFM-2)=XMERIT 


M8DIFIED  C8MPUTATI8NS  FOR  D8T  AND  ELEMENT-SPACE 
LIKELIHS8DS 


300 


IF(E0 
XMERI 
IF(XM 
IF(XM 
MERIT 
XMEPI 
IF(XM 
IF(XM 
MERIT 
XMERI 
IF(XM 
IF(XM 
MERIT 
XMERI 
IF(XM 
IF(XM 
MERIT 
XMERI 
IF(XM 
I F  (  X  M 
MERTT 
XMERI 
IF<XM 
IF(XM 
MERIT 
XNTC  = 
IF(NE 
RETUR 


UR/ 

T--'( 
FR! 
ERI 
(1/ 
T=( 
ERI 
ERI 

(2j 

T={ 
ERI 
ERI 
(1j 
T={ 
ERI 
ERI 
(2/ 
T=( 
ERI 
ERI 
(1j 
T=< 
ERI 
ERI 
(2, 
XNT 
LEM 
M 


3.#L,T« 

XHSM( I 

T.LT.O 


MF 


LC 


c  • 
JL 
.  J 
.  ) 

Ss/ 
.  ) 
.  ) 
M* 
J'< 
.  ) 
.  ) 

SM 
.  ) 
.  ) 

M  ■ 

J) 
•  ) 
.  ) 
M) 
S^ 
.  ) 
.  ) 


5*TS 

)/FM 

XME 

XML 
2)=X 

(  IJL 
XMT 

XME 

2)=y 

>/FM 

XME 

XMF 

1)»X 

(  UK 

XME 

XME 

1)»X 

/FME 

XME 

XMT 

=  XME 

(  I  J) 

XMF 

x*p: 

=  XME 


1 .- (XH 
T.LT.O 
T  .  G  T  .  1 
1/NEL.E 
XHSM( I 
r.LTtO 
T.GT.l 
1/NELE 
1 .- (XH 
T.LT.O 
T.GT. 1 
1/NELE 
XHSM( I 

T«LT.O 
T.GT.l 
1/NELE 

1  .-(XH 

T.LT.O 

T.GT.l 

1/NELE 

=  C 

.GE»9>  fi8  TO  301 


)  Gri  T8  300 

EANS+0#5)*( 1.-TM2* ( 1 .  *TM1 ) ) 

RIT=0. 

RIM. 

MERIT 

J/FMEANS+0.5) )* ( 1.-TM2* ( 1 »-TMl ) ) 

R I T  *  0  • 

R I T  ■  1  • 

MERIT 

ANS+0.5)* (l.«TM2*<l«"TMl ) ) 

IT  =  0. 

IT=1. 

ERIT 

/FMEANS+0i5) )»(1.*TM2*(1»-TM1) ) 

IT  =  0. 

IT=1. 

ERIT 

\S+0.5)*( 1 »-TM?« ( l.-TMl ) ) 

IT  =  0. 

IT  =  1. 

IT 

FMEA.NIS+0«5)  >*(l««TM2*(lt-TMl) ) 

IT  =  C 

I  T  =  1 . 

IT 


TAKE  THE  LQGARITv-S  F8R  USE  BY  THE  DECIDER 
THE  NUMBER  200  IS  USED  F8R  INFINITY 


301 


DO 
08 
D8 


501 
501 
501 


II' 

12' 
13' 


1/4 

1/nele: 

1/2 
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154 
155 
156 
157 
158 
159 
160 
161 
16? 
163 
164 
165 
166 
167 
16s? 
169 
170 
171 
172 


IF(MERIT(  Hi  I3iI2)tLE«0t  )  MFRIT( 11/ 13/  I?) =200.; 
1G9  TO  501 
MERIT (Il# I3j I2)«-AUBG(MERIT< 1 1/ 13/ I?)  ) 

5C1   CONTINUE 

CALL  DECODER 

INITIALIZE  LIKELIH980S  TOR  NEXT  ITERATION 

NCHAR»0 

DO  600  1*1*11 

MARK( I )=NSPACE( I )«0 
600   CONTINUE 

DO  505  11=1/4 

D9  505  12*1*12 

D8  505  13=1/? 
505   MERIT<Ii*I3iI2)»0« 

NELEM=0 

RETURN 

END 
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END 


9F 
1 
2 
3 

h 

5 
6 
7 

R 

9 
10 
11 
1? 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 
4  6 
47 


c 
c 
c 
c 

c 


IUATI6N 

SUBROUTINE  DECODER 

THIS  SUBROUTINE  IMPLEMENTS  THE 
VITERBI  ALGORITHM 


REAL 
REAL 
INTE 
DIME 
DIME 
DIME 
DIME 
DIME 

DIME 
C6MM 

C8MM 
COMM 
DATA 


L 

L 

GE 
NS 
\S 
NS 

NS 
NS 
NS 
SN 
ON 
ON 
L 


SAV/M 

NGTH1 

R  SEQ 

ION  L 

ION 

ISN 

I9N 

ION 

ION 

/BLOC 

/BLOC 

/BLOC 

/O/ 


ERI 
*LN 
SAV 

sav 

RAN 
ENG 
ERI 
APK 
SEQ 
K2/ 

<:v 

K4/ 


T#LAMDAiLEN3THiNU 

GTH2>LNGTH3iLNGTH4iUNGTH5^LNGTH6 

#CHAR 

(6*12)/ I  SAVE (6, 12)/WSAVE(5) 

S( 11 )/XTRANS( 11 ) 

TH(6) *YLNGTH(6) » WLNGTH ( 6 ) # ZLNGTH(6) 

T(4/2/ 1?) #CHAR(6i 12) 

( 1 1 )#NSPACE( 11 ) 

( 12)/NSQ( 12)/SEQSAV(5* 12) 

NELEM/ MERIT 

TRANS 

MARK/NSPACEiNCHAR 


ICO 


101 


10 


INITIALIZATION 

DO  80  1=1/12 
NSEQ< I )=NSQ( I )=0 

USE  A  PRIORI  PROBABILITIES  OF  EACH  CHARACTER 
FOR  INITIALIZATION 

LENGTHf 1)=-AL03(0.269) 

LENGTH(2)**ALQG(0t341 ) 

LENGTH(3) =LENGTH(4) =- ALPG ( 0 ♦ 1 59 ) 

LENGTH(5)=LENGTH(6) = - ALOG ( 0 .2  32 ) 

DO  100  I=l>6 

WLNGTH(  I  )=ZLNGTH(  I  )  =Yt.NGTH(  I  )  =200. 

CONTINUE 

DO  101  1=1/11 

XTRANSC I ) =0* 

CONTINUE 

DO  10  1=1/6 

DO  10  J=l/12 

LSAV( 1/ J)=0» 

ISAVE( 1/ J)=0 

CONTINUE 

SENSE  SWITCH  2  IS  USED  TO  SELECT  OUTPUT  OPTION 

IF (SENSE  SWITCH  2)  8/9 
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43 
49 
50 
51 
5? 
53 
54 
55 
56 
57 
5  3 
59 
60 
61 
62 
63 
64 
65 
66 
67 
68 
69 
70 
71 
72 
73 
7M 
75 
76 
77 
73 
79 
80 
81 
8? 
83 
84 
85 
86 
87 
88 
89 
90 
91 
92 
93 
94 
95 
96 
97 
9? 
9Q 
100 


8  WRITE-  (6,3000) 
3000  F9RMAT( ' 1 ' ) 

WRJTE(6*4010) 
4010  F0R^AT(5*, 'SURVIVOR  SEQUENCES') 

WRITE (6, 4  000)  (1,1=1,11) 
4000  F0RMAT(14X/12( I2/5X) ) 

9  C8NTINUE 

MAIN  ALGORITHM 

N9DE  1  IS  A  DOT 

NODE  ?  15  AN  ELEMENT  SPACE 

NODES  3  AND  4  ARK  LETTER-SF'ACES 

NODES  5  AND  6  ARE  DASKf-'S 


910 
911 


920 

C 

C   NG 


NELM1=NFLEM+1 

DO  900  K=1/NELM1 

IF<K#EQt2)  G8  T9  910 

GO  TO  911 

DP  qll  Jxlill 

XTRANS( J)=TRANS( J) 

CONTINUE 

IFU.ME.NELMl  )  GO  TO  920 

DO  920  J=l, 11 

XTRANS(vJ)  =0. 

CONTINUE 


300 


DA=LENGTH(2)+XTRANS(3) 
LENGTH(3)+XTRANS(5) 
NU«LT.LAMDA)  LAMDA=NU  ; 
ZL-NGTH(4)+XTRANS(5) 
NU»LT#LAMDA)  LAMDA=NU  i 
VE<  1,<)=I 

TH1=LAMDA+MERIT( 1/1jK) 
TINUE 


301 


Pfc  1 
LAM 

NU* 
IF( 
NU  = 
!F{ 

ISA 
LNS 

CON 

IODE  2 
LAMDA«LENGTH( 1 )+XTRANS( 1 ) 
NU*ZLNGTH(4)+XTRANS(6) 
IF(NUtLTtLAMDA)  LAMQA=NU 
NUS LENGTH  (5)4-X TRANS  <  9) 
IF(NU«LT.LAMDA)  LAMDA-NU 
NU*ZLNGTH(6)+XTRANS(9) 
IF(NU«LT.LAMDA)  LAMDA=NU 
ISAVE<2/K)"I 

LNGTH2=LAM0A+MER IT ( 2/ 1#K ) 
CONTINUE 

IODE    3 

l.AMDA  =  LENGTH(  1)+XTRANS(2) 
NU«LENGTH(5)+XTRAN5( 10) 


1=2 


1=3 


1=4 


1  =  1 


1=4 


i     1=5 


;    1*6 


;    1  =  1 
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1C1 
102 

103 
104 
105 
106 
107 
108 
109 
110 
111 
11? 
113 
114 
115 
116 
117 
113 
119 
120 
121 
122 
123 
124 
125 
126 
127 
128 
129 
130 
131 
132 
133 
134 
135 
136 
137 
133 
139 
140 
141 
142 
143 
144 
145 
146 
147 
148 
149 
150 
151 
152 
153 


IF"  (NU'LT.LAMDA  )  LAMOA-NU  i     1=5 
\U  =  ZLNGTH(6)+XTr?AN3(  10) 
IF(NU'LTiLAMDA)  LAMDA*NU  ;  1*6 
NU*LENGTH(2)+XTRANS< 11 ) 
IF<NU»LT»LAMDA)  LAMDA=NU  ;  1=2 
ISAVE<3/K)=I 
LNGTH3«LAMDA+MERIT(3;  1  $  K) 

302  CONTINUE 

N6DE  4 

LA^DA  «UENGTH(1>+XTRANS(2)  i     1=1 
NU»ZLNGTH(4)+XTRANS< 7) 
IF(\U«LT.LAMDA)  LAMDA*NU  ;  1=4 
NU=LENGTM(5>+XTRANS( 10) 
IF(NU»UT«LAMDA)  L^MDA=NU  ;  1*5 
NU*ZUNGTH(6)+XTRANS( 10) 
IF(NU«LT«LAMDA)  LAMDA»NU  ;  1=6 
NUaLENGTH(2)+XTRANS(ll) 
IF(NU»LT.LAMDA)  LAMDA*NU  ;  1=2 
ISAVE(4*K)=I 
LNGTH4=LAMDA+MERIT(3/2/K) 

303  CONTINUE 

!    NODE  5 

LAMDA=LENGTH(2)+XTRANS(4)  ;  1=2 

NU*L,ENGTH(3)+XTRANS(8) 

IF(NU»LT«LAMDA)  LAMDA=NU  ;  1=3 

NUSZLNGTH(4  )+XTf<ANS(8) 

IF(NU»LT«LAMDA)  LAMDA=NU  ;  1=4 

ISAVE(5/K)«I 

LNGTH5  =  UAMDA4.MERIT(4^1iK) 
3C+   C0NTINUE 

;    NPDE  6 

LAMDA*LENGTH(2)+XTRANS<4)  ;  1=2 

NU  =  LENGTH(3)+XTRA\'S(8) 

IF(NU»LTtLAMDA)  LAMDA*NU  ;  1=3 

NUSZLNGTH(4)+XTRANS(8) 

IF(\U»LT.LA^DA)  LAMDA*NU  ;  1=4 

ISAVE(6/K)=I 

L\'GTM6  =  LAVDA  +  ME^IT(  k,?,K) 
305   CONTINUE 


C 
C 

c 


11 


ST9RE  LFNGTHS  FPR  SURVIV6R  SEQUENCES 

LENGTH ( 1 )=LNGTH1 
LENGTH(2)»LNGTH2 
LENGTH(3)*LNGTH3 
LENGTH (4 ) =LNGTH4 
LENGTH(5)*LNGTH5 
LENGTH(6)*LNGTH.6 

oe  li  i=i/6 

LSAV( I#K)«LENGTH< I ) 
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15'+ 
155 
156 
157 
15S 
15? 
160 
161 
162 
163 
164 
165 
166 
167 
168 
169 
170 
171 
17? 
173 
174 
175 
176 
177 
17? 
179 
180 
1S1 
18? 
183 
184 
185 
186 
187 
188 
189 
190 
191 
19? 
193 
194 
195 
196 
197 
198 
199 
?00 
?01 
20? 
203 
204 
205 
206 


DO  200  1  =  1/6 
ZUNGTH< I )=YLNGTH< I ) 
YLNGTH( I >=WLNGTM( I ) 
*/LNGTH{  I  ) -LENGTH (  I  ) 
200   CONTINUE 

900  C9NTJNUE 

C 

C    DETERMINE  MINIMUM  LENGTH  SEQUENCE  FROM  THE 

C    SIX  SURVIVOR  SEQUENCES 

C 

NU8LENGTH(D  i     ISURV»1 

DO  901  1=2/6 

IF ( LENGTH ( I ) .LT«NU)  NU=LENGTH(I)  ;  ISURV*I 

901  CONTINUE 
WE1GHT=LENGTH( ISURV) 
I M  ■  1 

y,  =  0 

N=  I  SAVE ( ISURV/NELMi ) 
NSEC( 1 )=N 
32    CBNTINUE 

IF( (N»EQ-^> «9R« (N»EQ.6> )  36  TO  30 

IF( (NELM1*M) .LEtO)  GO  TO  35 

NSMSAVECNjNELMl-M) 

GO  TO  31 

30  M3M+3 

IF( (NELMl-M).LE'O)  G8  TO  35 
NS«ISAVE(N/NELM1*M) 

31  IMMM  +  1 
NSEQ( IM) =N=NS 
GO  TO  32 

35    CONTINUE 

DO  40  I=1/IM 
40    NSQ( I )=NSEQ( IM-I+1  ) 

L  =  L+1 

WSAVE(L) "WEIGHT 

DO  71  1*1, IM 
71    SEQSAVCL* I)3NSQ(I) 

IM1«JM+1 

DO  73  I  =  IN1/  1? 
73    SEQSAV(L/ I  )=0 


C 

C 

c 

c 
c 
c 


OUTPUT 

IF (SENSE  SWITCH  2)  60/70 
OUTPUT  OPTION  1  -  DETAILED  OUTPUT 


60 


CONTINUE 

DO    1?    J=l/6 
12  k'RITE(6/4C01  )     J/  (  ISAVE(  J/O/K-I/NElCM) 

4001     F0RNAT(&X/1?( I  1 #  6X )  ) 

WRITE (6/ 4  00?) 
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4002 

5000 

13 
4003 

1003 


903 


1002 

4021 

4020 

904 

1000 

960 


70 


F8 
wR 
F0 
D9 
WR 
F8 
aR 
aR 
F9 
U 
JI 
09 
JI 
^ 
09 
D9 
JI 
WR 
F9 
WR 
WR 
F9 
WR 
F9 

1  »S 
WR 

IK* 
F9 
D8 
aR 
C9 
IF 
G9 
IF 


RMA 
ITE 
RMA 

13 
I  IF 
RMA 
ITE 
ITE 
RMA 
=  1 
»0 

90 
■JI 
ITL 

90 

9C 
■JI 
ITE 
RMA 
ITE 
ITE 
RMA 
ITE 
RMA 
ECU 
ITE 
2/1 
RMA 

96 
ITE 
NTI 
(L. 

TO 


T(/) 

(6/5000) 

T(5X/ •SURVIV9R  LENGTHS') 

J=l/6 
(6*4  003)  J, (LSAV( J/K) /<=1/NELEM) 
T(8X/ Il#2Xi 12(F6.2/  IX)  ) 
(6/^002) 
(6/1C03) 
T(5X/ 'LIKELIHOODS'  ) 


3    1=1/2 

+  1 

(6/ 1002)    JI/ (MERIT* If  I  J/ K >#K=1#NELEM) 

5    1=3/4 

5    IJ^l/2 

+  1 

(6/1002)  JI* (MERIT ( I# I  J/ K ) /K*l# NELEM J 

T(SXf I 1/2X/ 12(F6t2f IX ) ) 

(6/4002) 

(6/4021 ) 

T(63Xf  »0EC9DED'  ) 

(6/4020) 

T(?4X/ ' * ARK'/ 3X/ 'SDACE'/ 12X/ 'LENGTH' /9X, 

ENCE' ) 

(6/ 1000)  MARK( 1 ) /N3PACE( 1  )/ WEIGHT/  (NSQ(K)/ 

M) 

T(20X/ I5/3X/ I5/11X/F9.3/ 1CX/ 1211 ) 

C  I=2*NCHAR 

(6/1000)  MARK<  I )/NSPACE( I  ) 

NUE 

EQ.5)  L=0 

72 
N'E«5)  G9  TO  72 


OUTPUT  OPTION  2  -  DECODED  SEQUENCES  AND  LENGTHS  9NLY 


6000 
6001 

6003 
72 


L  =  0 

WRITE 
WRITE 
FOR^A 
F9RMA 

WRITE 
F9RMA 

CONTI 

RETUR 

END 


(6/6000)  (W8AVE( I )f 1=1*5) 

(6/6001)  ( (SEQSAV( I/J)/J=2/ 12)/ 1=1/5) 

T(SX/5(F9.3/2X)//) 

T(5Xf5(llIlf IX) ) 

(6/6003) 

T(//> 

NUE 

N 
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^FORTRAN  LS/GO 

THIS  PWPGRAM 
DESCRIBED  IN 


1 
2 
3 
4 
5 
6 
7 
8 

Q 

10 

11 

12 
13 

14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 
46 
47 
<+8 
49 
50 
51 


C 

c 

c 


IMPLEMENTS 

THE  THESIS 


THE  PRE-DETECTION  FILTER 
TEXT 


21 


100 


REAL  LDOT/MEANX/  IDEN-T 

D I  MENS  I  ON  I  DENT  (  2/  2  ) ,  GA  I  N  (  2  )  /  H  (  2  ) 

DIMENSION  TEMPM(2/2)/TEMPMl  (  2/  2  )  ,  TEMPR  (  ?  )  /  TEMPC<2) 

DIMENSION  EVAR(2/2)  /PVAR(2/2)  /PHI  (2/  2)  /PH  IT  (2/2) 

DIMENSION  I3'JP(4000> 

NAMELIST  LD0T/DDASH/T/T1/T2/FREQ 


OUTPUTS  101 ) 

OUTPUT ( 101  ) 

INPUTdOl  ) 


•ENTER  T  AND  FREQ' 
'LOOT  AND  DDASH' 


INITIALIZE  VARIABLES  AND  INDICES 

XP1=XP2=0»5 

TAU=0« 00025 

KT  =  0 

KIND=JIND=0 

XOUT=C. 

MEANXsOt 

SS  =  0. 

VARx=0.5 

T=4.*T  ;  LD0T=4.*LD0T;  DDASH=4 t*DDASH 

T1S4.*T1  ;  T2=4.*T2 

FREQs6#28319#FREQ 

TD=3.*T 

IXHL*0 

P«1»0 

DO  20  1=1/2 

PHI ( 1,1 )=1, 

PHIT(  I/D-1- 

CONTIN'UE 

PHI (1#2)»PHIT(2*1 )=FREQ*TAU 

PHI  (2/l)=PHIT(l/2)=»FREQ*TAU 

DO  21  1=1,2 

DO  21  J*1j2 

I  DENT ( I/J)*0. 

EVAR( 1/ J)=0. 

PVAR( I, J)=0« 

CONTINUE 

PVAR( 1  , 1 )=PVAR(?i2)  =  l  . 

I  DENT ( 1/1 )*IDENT(2/2)=1# 

H(l)=l« 

H(2)=C. 

CONTINUE 

INPUT  DATA  FROM  TAPE 

CALL  BUFFERIN( 1/ 1/ IBUFi 4000/ IERR) 
IF( IERR.EQ.l)  GO  TO  1 
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52 
53 
54 
55 
56 
57 
58 
59 
60 
61 
62 
63 
64 
65 
66 
67 
68 
69 
70 
71 
72 
73 
74 
75 
76 
77 
78 
79 
80 
81 
8? 
83 
84 
85 
86 
87 
88 
89 
90 
91 
92 
93 
94 
95 
96 
97 
98 
99 
IOC 
101 
102 
103 
104 


c 
c 
c 


GO  TQ  (1/111/310/112)  IERR 
111   DO  999  INDEX-1,4000 

BEGIN  PROCESSING 

XI "FLOAT < IBUF( INDEX) )/2#*23 
X2*X1 

Xl=P#Xl 

IF('<T.3T. 1000000)  KT  =  C 

<T=KT+1 

CALL  STATS 

GAIN 

CALL    ^VhnjLT(PVA^/H/TEMPC) 
CALL    VVMULKH/TEMPC/TEMP) 
TEM°1* 1 ./(TE^P+VARX) 
CALL    MVMULKPVAR/H/TEMPC) 
GAIN(1 )=TEMPC< 1 >*TEMP1 
GAIN(2)"TEMPC(2)*TEMP1 

ESTIMATION 

XH1=XP1+GAIN( 1 ) » (X1-XP1 ) 
XH2»XP2+GAIN(2)*(X1-XP1) 

ESTIMATION  VARIANCE 

CALL  VMULT(GAIN/HjTEMPM) 
D9  200  1=1/2 
DO  200  J=l/2 
200   TEMnv( 1/ J)»IDENT< 1/ J)-TEMPM( 1/ J) 
CALL  MMULT ( TEMPM#PVAR/EVAR ) 

PREDICTION  VARIANCE 

CALL  MMULT(EVAR,PHIT/TEMPM) 
CALL  MMULT(PHI/TEMPM/PVAR) 

ONE-STEP  PREDICTION 
XP1=XH1+PHI (1/2) *XH2 
XP2=PHI (2/ 1 ) «XHl+XH2 

SQUARE  FILTERED  ESTIMATE  AND  LOW'PASS  FILTER 

X=XH1*«2 

XKT=KT   ■ 

IF(KT.GT.50)  GO  T9  60 
X9UT=X8UT+( l./X<T)*(X-XOUT) 
GO  TO  61 

60  X0UT«XQUT+O»O2*(X«XOUT) 

61  CONTINUE 
IXHAT=-1 

IF(X9UT.GE*MEANX)  IXHATM 
CALL  VARw 


OUTPUT  VALUES  TO  D/A  KOUTINE  FOR  ANALOG  RECORDING 
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105 
106 
107 
108 
109 
110 
111 
112 
113 
114 
115 
116 
117 
113 
119 
120 
121 
12? 
123 
124 
125 
126 
127 
128 
129 
130 
131 


XXHAT  =  FU0AT(  IXHM) 

CALL  DAL(X2*X1/XH1*X0UT*GAIN( l)*EVAR(l#l  )*EVAR(2/2)  , 
1VARX/P/XXHAT) 

999   C9NTINUE 
310   G9  T8  100 


C 

c 

c 

c 

c 
c 

c 


70 
71 


80 


SUBROUTINE  STATS 
T^IS  SUBROUTINE  ESTIMATES  THE  N8I5E  VARAlNCE 


XKT=KT 

IF(KT«GT.4000)  G8  T6  70 

MEANX*MEANX+< 1 ./XKT)« (XOUT-MEANX) 

GO  T3  71 

MEANX*MEANX+(  1«M000»  )*(X8UT*MEANX) 

CONTINUE 

IF(X0UT.3T.MEANX)  G0  T9  80 

SS»SS+0»01*(XBUT»SS) 

CONTINUE 

VARX=SS 

IF(VARX.LE»0.01 )  VARX=0»01 

RETURN 

END 
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aFGRTRAN  LSi 

GO 

1 

subroutine:  myult(a,B/C) 

? 

.  c 

MULTIPLY  TWO  MATRICES 

3 

DIMENSION  A(2/2)/B(?/2)/C(2 

<♦ 

DO  10  1=1/2 

5 

DO  10  J=l/2 

6 

'   1C 

C  (  1  /  J  )  =  0 . 

7 

DO  20  1=1/2 

8 

DO  20  J=l/2 

9: 

DO  20  K=l/2 

10: 

C( 1/ J)=A( I>K)»B(K/J)+C< 1/ J) 

11 

?c 

CONTINUE 

12! 

RETURN 

13: 

END 

2) 
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END  8F 
1 
c 
3 
k 
5 
6 
7 
8 
9 
10 
11 


COMPILATION 

SUBROUTINE  MvN'ULT  (  A,  3/ C  ) 
C    MULTIPLY  MATRIX  BY  COLUMN  VFCT8R 

DIMENSION  A(2<2)*B(2)/C<2) 

D9  10  1=1/2 
10    C< I >*0. 

D3  20  1=1/2 

D3  20  K«1j2 

C( I )*A( IjK)*B<K)+C< I ) 
20    CONTINUE 

RETURN 

END 
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END  OF  COMPILATION 

I!  SUBROUTINE  VMM'JLT(A,5,C) 

2:  C    MULTIPLY  ROW  VECTOR  3Y  MATRIX 

3:  DIMENSION  A  (  2  ) ,  a  (  ?.,  2  )  ,  C  (  2  ) 

k\  DO  10  1=1*2 

5:  10   c( i )=c. 

6:  DO  PC  1=1/2 

7:  DO  20  K=l/2 

8  5  C(  I  )=A(K)*3('<i  I  )+C(  I  ) 

9:  20    CONTINUE 

10:  RETURN 

11  :  END 
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END 


6F 
1 
2 
3 
<t 
5 

6 
7 
8 

9 


CQMPILATieN 

SUBROUTINE 
C    MULTIPLY  R8W 


VV^ULT(A,n/C) 

vector  by  column  vector 


10 


DIMENSION  A(2)i5(2) 

c*o. 

DO  10  1=1,2 
C*A( I )«B( I )+C 

CONTINUE 

RETURN 

END 
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END  er 

ce 

KPILATI6N 

l: 

SUBROUTINE  VMULT<A/L/C) 

2: 

c 

MULTIPLY  COLUMN  VECTOR  BY  ROW 

3: 

DIMENSION  A(?),B(2),C(2/2) 

M 

DO  10  1=1/2 

5  * 

DO  10  J* 1*2 

6: 

C( IiJ)sA( I)»B(J) 

7: 

10 

CONTINUE 

8; 

RETURN 

9: 

END 

VECTOR 
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